Superimposed annotation output

• US 9,715,326 B2
• Filed: 03/16/2011
• Issued: 07/25/2017
• Est. Priority Date: 03/16/2011
• Status: Expired due to Fees

• Current Assignee: Peking University
• Original Assignee: Peking University
• Inventors: Yuan, Xiaoru
• Primary Examiner(s): Merouan, Abderrahim
• Application Number:
  US13/502,011
• Publication Number:
  US 20130027425A1
• Time in Patent Office: 2,323 Days
• Field of Search: 345629
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/632 using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

Technologies are generally described for systems and methods effective to display a first output and simultaneously display a second output corresponding to user input superimposed on the first output. In some examples, a second output is displayed on a display simultaneously with and superimposed on a first output. The second output corresponds to user input. In an area of the display that the first output and the second output overlap, the second output is opaque and the first output is visible through the opaque second output. In an area of the display that the first output and the second output do not overlap, the first output is visible. The first output may be a video portion of a video telephone conference, and the second output may correspond to annotations or notes that are received from a user during the telephone conference.

Claims

1. A method for user interface processing, the method comprising:

playing a video on a display;

receiving an input on a spatial location of the display associated with a portion of the video simultaneously with the video being played and while the video continues to play on the display;

displaying, on the display, an output superimposed on the video at a location on the display that corresponds to the spatial location associated with the portion of the video where the input was received and at a time simultaneously with the input being received, wherein the output corresponds to the received input, wherein the received input includes one or more annotations, and wherein the output is movable to another location of the display in response to another input;

mapping data indicative of the output into, over, or both, buttered data for the portion of the video, such that the output appears superimposed on the video while the video continues to play on the display and the input is received on the display,

wherein in an area of the display that the video and the output overlap, the video is visible through the output, and

wherein in an area of the display that the video and the output do not overlap, the video is visible;

storing the received input;

storing the video;

retrieving the video and the one or more annotations separately and independently; and

and

displaying the retrieved video and the retrieved one or more annotations separately and independently.

2. The method of claim 1, wherein receiving the input comprises receiving the input via a touch sensitive screen.

3. The method of claim 1, wherein receiving the input comprises receiving the input via computerized voice recognition.

4. The method of claim 1, wherein playing the video comprises playing a video stream of an audio/video conference.

5. The method of claim 1, further comprising:

storing information that synchronizes the retrieved one or more annotations with the retrieved video;

retrieving the information that synchronizes the retrieved one or more annotations with the retrieved video; and

displaying the retrieved video and the retrieved one or more annotations, the retrieved one or more annotations superimposed on and synchronized with the retrieved video.

6. The method of claim 1, wherein playing the video comprises playing a first portion of the video and playing a second portion of the video, the method further comprising:

receiving the second portion of the video while playing the first portion of the video.

7. The method of claim 1, further comprising moving the output automatically or in response to the another input to have a smaller amount of overlap with the video.

8. An apparatus, comprising:

a display;

an input device; and

a computing processor, the computing processor communicatively coupled with the display and the input device;

wherein the apparatus is configured to;

play a video on the display;

receive, via the input device, an input simultaneously with the video being played and on a spatial location of the display that includes at least a portion of the video;

display, on the display, an output superimposed over the video at the spatial location of the display that includes the at least the portion of the video, wherein the output corresponds to the received input, and wherein the output is movable to another location of the display in response to another input;

map data indicative of the output into, over, or both, buffered data for the at least the portion of the video, such that the output appears superimposed on the video while the input is received simultaneously with the video being played;

adjust a level of opaqueness of the output,

wherein the video is visible through the output;

store the received input, the received input comprising one or more annotations;

store the video;

retrieve the video and the one or more annotations separately and independently; and

display the retrieved video and the retrieved one or more annotations separately and independently.

9. The apparatus of claim 8, wherein the output comprises the one or more annotations.

10. The apparatus of claim 9, wherein the input device comprises a touch sensitive screen.

11. The apparatus of claim 9, wherein the input device comprises computerized voice recognition.

12. The apparatus of claim 9, wherein the apparatus is further configured to:

store information that synchronizes retrieved one or more annotations with the retrieved video;

retrieve the information that synchronizes the retrieved one or more annotations with the retrieved video; and

display the retrieved video and the retrieved one or more annotations, the retrieved one or more annotations superimposed on and synchronized with the retrieved video.

13. The apparatus of claim 8, wherein the apparatus is configured to play the video by playing a video stream of an audio/video conference.

14. The apparatus of claim 8, wherein the video comprises a first portion of the video and a second portion of the video, wherein the apparatus is further configured to:

receive the second portion of the video while playing the first portion of the video.

15. The apparatus of claim 8, wherein the apparatus is further configured to move the output automatically or in response to the another input to have a smaller amount of overlap with the video.

16. A non-transitory computer readable medium that stores executable instructions that, in response to execution, cause one or more processors to perform or control performance of operations to:

play a video on a display;

identify an input on a spatial location of the display playing the video simultaneously with playing the video;

display, on the display, at the spatial location of the display where the input was identified, an output superimposed on the video, wherein the output corresponds to the identified input, and wherein the output is movable to another location of the display in response to another input;

continue to play the video on the display while the input is identified and the output is displayed;

map data indicative of the output into, over, or both, buffered data for the video, such that the output appears superimposed on the video while the video continues to play on the display and the input is identified on the display,

wherein in an area of the display that the video and the output overlap, the output is visible and the video is partially obscured but visible through the displayed output, and

wherein in an area of the display that the video and the output do not overlap, the video is visible;

store the identified input, the identified input comprising one or more annotations;

store the video;

retrieve the video and the one or more annotations separately and independently; and

display the retrieved video and the retrieved one or more annotations separately and independently.

17. The non-transitory computer readable medium of claim 16, wherein the operations to display the output comprise operations to display the one or more annotations.

18. The non-transitory computer readable medium of claim 17, wherein the operations to identify the input comprise operations to identify the input via a touch sensitive screen.

19. The non-transitory computer readable medium of claim 17, wherein the operations to identify the input comprise operations to identify the input via computerized voice recognition.

20. The non-transitory computer readable medium of claim 17, wherein the executable instructions comprise instructions that, in response to execution, cause the one or more processors to perform or control performance of at least one operation to:

store information that synchronizes the retrieved one or more annotations with the retrieved video; and

display the retrieved video and the retrieved one or more annotations, the retrieved one or more annotations superimposed on and synchronized with the retrieved video.

21. The non-transitory computer readable medium of claim 16,

wherein the operations to play the video comprise operations to play a first portion of the video and operations to play a second portion of the video,

and wherein the executable instructions comprise instructions that, in response to execution, cause the one or more processors to perform or control performance of at least one operation to:

identify the second portion of the video while playing the first portion of the video.

22. The non-transitory computer readable medium of claim 16, wherein the executable instructions comprise instructions that, in response to execution, cause the one or more processors to perform or control performance of at least one operation to move the output automatically or in response to the another input to have a smaller amount of overlap with the video.