DOCUMENT CONTENT REPLAY

• US 20170285930A1
• Filed: 08/15/2016
• Published: 10/05/2017
• Est. Priority Date: 04/01/2016
• Status: Active Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Sykes, Sarah, Hartman, Jason H., Mikutel, Ian William
• Application Number:
  US15/237,425
• Publication Number:
  US 20170285930A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06V 30/387 using human interaction, e.g. selection of the best displayed recognition candidate
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region

Abstract

Incremental replay of content in an electronic workspace canvas is provided. Content can be selected for replay. Replay of the content can be played forward or backward to hide or reveal content. Interaction with and adding or modifying content is enabled while it is being replayed. Annotations may be added to the replayed content and set for display at specific times or positions during the replay order.

Claims

1. A computer storage medium including instructions, which when executed by a computer, provide:

a productivity application;

an application programming interface for incrementally replaying content in a graphical user interface of the productivity application; and

an incremental content replayer, in communication with the productivity application via the application programming interface, operative to;

receive a selection of an area of interest in the graphical user interface for which to replay the content from the productivity application displayed therein, wherein the content is comprised of a plurality of content elements;

establish a replay order of the content in the area of interest;

receive an indication of a starting point and a replay mode;

when the replay mode is backward;

identify a foremost content element relative to the starting point currently displayed; and

change a display state of the foremost content element to hidden;

when the replay mode is forward;

identify a backmost content element relative to the starting point currently displayed; and

change a display state of the backmost content element to visible;

receive an annotation during replay of the content; and

assign the annotation to the replay order at a given position based on a current position of the replay order, wherein a display state for the annotation is visible at the given position and hidden at other positions in the replay order.

2. The computer storage medium of claim 1, wherein in establishing the replay order of the content in the area of interest, the incremental content replayer is operative to index each content element with a z-order value based on a hierarchical structure of the content in the area of interest within the productivity application.

3. The computer storage medium of claim 1, wherein in establishing the replay order of the content in the area of interest, the incremental content replayer is operative to index each content element with a z-order value based on a timestamp.

4. The computer storage medium of claim 1, wherein when the replay mode is forward the incremental content replayer is further operative to:

identify content elements from the plurality of content elements that are forward in the replay order relative to the starting point; and

set display states for the content elements that are forward in the replay order to hidden.

5. The computer storage medium of claim 1, wherein the plurality of content elements are grouped according smart grouping into characters.

6. The computer storage medium of claim 1, wherein in response to receiving the selection of the area of interest, the graphical user interface is further operable to display replay command user interface elements that are selectable to receive the indication of the starting point and the replay mode.

7. The computer storage medium of claim 6, wherein the replay command user interface elements are displayed proximate to the area of interest.

8. The computer storage medium of claim 6, wherein the replay command user interface elements include:

a scrub bar;

a play/pause command button;

a rewind command button; and

a fast forward command button.

9. A method for incrementally replaying content in a graphical user interface, comprising:

receiving a selection of an area of interest from which content is to be replayed, the content including a plurality of content elements;

establishing a replay order of the plurality of content elements;

receiving an indication of a starting point and a replay mode, wherein the replay mode is selected from forward and backward;

in response to the replay mode being backward;

identifying a foremost content element currently displayed in the area of interest relative to the starting point;

changing a display state of the foremost content element to hidden; and

updating the foremost content element according to the display state in the graphical user interface;

when the replay mode is forward;

identifying a backmost content element currently displayed in the area of interest relative to the starting point;

changing a display state of the backmost content element to visible; and

updating the backmost content element according to the display state in the graphical user interface;

receiving an annotation during replay of the content; and

assigning the annotation to the replay order at a given position based on a current position of the replay order, wherein a display state for the annotation is visible at the given position and hidden at other positions in the replay order.

10. The method of claim 9, wherein establishing the replay order of the content in the area of interest comprises indexing each content element with a z-order value based on hierarchical structure.

11. The method of claim 9, wherein establishing the replay order of the content in the area of interest comprises indexing each content element with a z-order value based on a timestamp.

12. The method of claim 9, wherein changes to display properties of the content are excluded from a z-order.

13. The method of claim 9, further comprising:

parsing the content in the area of interest and counting the plurality of content elements to provide a range of replay.

14. The method of claim 13, further comprising:

displaying a replay functionality in the graphical user interface according to the range of replay, the replay functionality operable to receive the indication of the starting point and the replay mode.

15. The method of claim 14, wherein the replay functionality is displayed in the graphical user interface proximate to the area of interest and includes a scrub bar indicating the starting point relative to the range of replay.

16. The method of claim 9, wherein in response to receiving the indication of the starting point, hiding each content element of the plurality of content elements ahead of the starting point in the replay order.

17. A system for incrementally replaying content in a graphical user interface, comprising:

an incremental content replayer comprising;

an input manager operative to receive a selection of an area of interest in the graphical user interface;

a replay order generator operative to identify content authored in the area of interest, the content comprising a plurality of content elements, and to establish a replay order of the plurality of content elements in the area of interest;

a state selector operative to;

determine a replay mode;

when the replay mode is backward;

identify a foremost content element according to the replay order that is currently displayed in the area of interest; and

hide the foremost content element from display in the graphical user interface;

when the replay mode is forward;

identify a backmost content element according to the replay order that is currently displayed in the area of interest;

change a display state of the backmost content element from hidden to visible;

receive new content elements authored in the area of interest at a current position of the replay order while replaying the content;

add the new content elements to the plurality of content elements in the replay order at the current position of replaying the content; and

a user interface engine operative to update the graphical user interface.

18. The system of claim 17, wherein hiding the foremost content element from display in the graphical user interface applies a reduced visibility effect to the foremost content element.

19. The system of claim 17, wherein when the replay mode is forward, all content elements of the plurality of content elements that ahead of the backmost content element according to the replay order are hidden from display in the graphical user interface.

20. The system of claim 17, wherein the new content elements are annotations whose display states are hidden except at the current position of the replay order, where the display states are set to visible by the state selector.