Merging annotations of paginated digital content

• US 10,331,777 B2
• Filed: 12/31/2013
• Issued: 06/25/2019
• Est. Priority Date: 12/31/2013
• Status: Active Grant

• Current Assignee: Barnes & Noble College Booksellers LLC (Barnes & Noble Education, Inc.)
• Original Assignee: Barnes & Noble College Booksellers LLC (Barnes & Noble Education, Inc.)
• Inventors: Hicks, Kourtny M., Mesguich Havilio, Amir, Cueto, Gerald B.
• Primary Examiner(s): Mills, Frank D
• Assistant Examiner(s): El-Bkaily, Ahmad M
• Application Number:
  US14/145,119
• Publication Number:
  US 20150186349A1
• Time in Patent Office: 2,002 Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes

Abstract

Features and techniques are disclosed for interacting with paginated digital content, including a multi-purpose tool and an annotation mode. The multi-purpose tool, which may be represented by a graphic (e.g., a movable interactive graphic), can provide access to multiple modes (e.g., copy, define, note, and/or highlight modes) that a user can invoke. The mode invoked determines the functions performed by the tool when interacting with the paginated digital content. The annotation mode, which may be invoked using the multi-purpose tool or independently thereof, can allow a user to create and edit annotations, such as highlights and notes (e.g., sticky notes, margin notes, and/or highlight notes), for paginated digital content. Editing the annotations may include selecting a desired color for the annotation, for example. The annotation mode may also allow a user to intuitively merge and delete annotations previously added to paginated digital content.

Claims

1. An electronic device, comprising:

a display for presenting paginated digital content to a user; and

a user interface operable on the device and including an annotation mode, the annotation mode configured to

create a first sticky note in response to a tap gesture on the paginated digital content, wherein the first sticky note is represented in a first state by an edit box and a second state by a movable graphic, the edit box of the first state being displayed over the paginated digital content and further being configured to receive first user generated content, wherein a tap gesture performed outside the edit box on the paginated digital content causes the first sticky note to transition from the first state to the second state, wherein the first user generated content presented in the edit box of the first sticky note in the first state is not visible in the second state while the moveable graphic is displayed over the paginated digital content, and

merge the first sticky note having a first location in the paginated digital content with a second sticky note having a second location in the paginated digital content in response to at least dragging and dropping the first sticky note while displayed in its second state in which the first user generated content is not visible onto the second sticky note to create a merged sticky note, and

display a merged sticky note edit box in response to creating the merged sticky note, wherein the merged sticky note edit box is presented over the paginated digital content, wherein the second user generated content of the second sticky note and the first user generated content are visible within the merged sticky note edit box, and wherein the merged sticky note inherits color properties from at least one of the first sticky note and the second sticky note and inherits the location of the second sticky note, and

save the merged sticky note at the location of the second sticky note in response to one of a tap gesture performed outside the merged sticky note edit box on the paginated digital content and an input performed on a save button presented in the merged sticky note edit box;

wherein in response to merging the first sticky note with the second sticky note, the first sticky note is no longer present at the first location within the paginated digital content.

2. The device of claim 1 wherein when the first sticky note is hovering over the second sticky note, the first sticky note grows and includes a border to indicate that the first sticky note has been grabbed.

3. The device of claim 1 wherein the annotation mode is configured to undo a most recent merge in response to an undo input.

4. The device of claim 1 wherein the merged sticky note inherits color properties from the second sticky note.

5. The device of claim 1 wherein the first sticky note is a first highlight note associated with a first highlight and the second sticky note is a second highlight note associated with a second highlight, wherein the first highlight note is merged with the second highlight note, in response to dragging and dropping the first highlight onto the second highlight to create a merged highlight note associated with a merged highlight.

6. The device of claim 5 wherein the merged highlight note inherits color from the first sticky note.

7. The device of claim 5 wherein one of the first highlight and the second highlight includes handles on either end of the highlight that allow the highlight to be dragged to expand or contract the highlight from either end.

8. The device of claim 5 wherein when the dragged first highlight is positioned over the second highlight, the first highlight displays a visual feedback to indicate that the first highlight is selected.

9. The device of claim 1 wherein the first sticky note is merged with a highlight note that is associated with a highlight, in response to dragging and dropping the first sticky note on the highlight note to create a merged highlight note associated with the highlight.

10. The device of claim 1 wherein the first sticky note is merged with a highlight in response to at least dragging and dropping the first sticky note on at least a portion of the highlight to create a highlight note.

11. The device of claim 1 wherein a highlight is merged with the first sticky note in response to at least dragging and dropping the highlight on at least a portion of the first sticky note to create a highlight note.

12. The device of claim 1 wherein in response to an undo input the merged sticky note is undone by one of:

returning the first sticky note to the first location in the paginated digital content;

or

returning the second sticky note to the second location in the paginated digital content.

13. The device of claim 12 wherein the undo input includes at least one of a shake input and a Z-shaped gesture input.

14. A mobile computing device, comprising:

a processor;

a touch screen display for displaying paginated digital content to a user and allowing user input; and

a user interface executable by the processor and including an annotation mode, the annotation mode configured to;

create a first highlight note associated with a first highlight in response to dragging a first highlight note over the first highlight, wherein the first highlight note is represented in a first state by an edit box and a second state by a movable graphic, the edit box of the first state being displayed over the paginated digital content and further being configured to receive first user generated content, wherein a tap gesture performed outside the edit box on the paginated digital content causes the first highlight note to transition from the first state to the second state, wherein the first user generated content presented in the edit box of the first highlight note in the first state is not visible in the second state while the moveable graphic is displayed over the paginated digital content;

the first highlight note located adjacent to or on the first highlight within the paginated digital content, and

merge the first highlight note having a first location in the paginated digital content with a second highlight note associated with a second highlight and having a second location in the paginated digital content in response to at least dragging and dropping the first highlight note while displayed in its second state in which the first user generated content is not visible onto the second highlight note to create a merged highlight note, and display a merged highlight note edit box in response to creating the merged highlight note, wherein the merged highlight note edit box is presented over the paginated digital content, wherein the second user generated content of the second highlight note and the first user generated content are visible within the merged highlight note edit box, and wherein the merged highlight note inherits color properties from the first or second highlight note and is located in front of the merged highlight within the paginated digital content and includes the second user generated content and the first user generated content, such that the first user generated content is after the second user generated content;

save the merged highlight note at the location of the second highlight note in response to one of a tap gesture performed outside the merged highlight note edit box on the paginated digital content and an input performed on a save button presented in the merged highlight note edit box;

wherein in response to merging the first highlight note with the second highlight note, the first highlight note is no longer present at the first location within the paginated digital content.

15. The device of claim 14 wherein at least one of visual, aural, and tactile feedback is provided:

in response to the press-and-hold input performed on the first highlight to select the first highlight note and before dropping the selected first highlight on the second highlight to create the merged highlight note, wherein merging of the first highlight note and the second highlight note is not allowed prior to the feedback being given.

16. A computer program product including one or more non-transitory processor readable mediums encoded with instructions that when executed facilitate operation of an electronic device according to a process, the process comprising:

in response to a tap gesture on the paginated digital content create a first sticky note wherein the first sticky note is represented in a first state by an edit box and a second state by a movable graphic, the edit box being displayed over the paginated digital content and further being configured to receive first user generated content, wherein a tap gesture performed outside the edit box on the paginated digital content causes the first sticky note to transition from the first state to the second state, wherein the first user generated content presented in the edit box of the first sticky note in the first state is not visible in the second state while the movable graphic is displayed;

in response to a press-and-hold input performed on the first sticky note previously added to a first location in the paginated digital content and in its second state, allow the first sticky note to be dragged; and

in response to dragging and dropping the first sticky note while displayed in its second state in which the first user generated content is not visible onto a second sticky note previously added to a second location in the paginated digital content, the second sticky note having a second user generated content, merge the first and second sticky notes to create a merged sticky note and display a merged sticky note edit box, wherein the merged sticky note edit box is presented over the paginated digital content, wherein the second user generated content and the first user generated content are visible within the merged sticky note edit box, and the merged sticky note inherits color properties from one or both of the first sticky note and the second sticky note and inherits the location of the second sticky note; and

in response to one of a tap gesture performed outside the merge edit box on the paginated digital content and an input performed on a save button presented in the merge edit box, save the merged sticky note at the location of the second sticky note;

wherein in response to merging the first sticky note with the second sticky note, the first sticky note is no longer present at the first location within the paginated digital content.

17. The computer program product of claim 16, wherein the process is further configured to undo the merged sticky note in response to an undo input, wherein the merged sticky note is undone by causing the first sticky note to return to the first location.

18. The computer program product of claim 17, wherein the undo input includes at least one of a shake input and a Z-shaped gesture input.

19. The computer program product of claim 16, wherein the process is further configured to present a dialog requesting to undo the merged sticky note in response to merging the first sticky note with the second sticky note.

20. The computer program product of claim 16, wherein the process is further configured to provide at least one of visual, aural, and tactile feedback:

in response to the press-and-hold input performed on the first sticky note to indicate that the first sticky note is allowed to be dragged and dropped on the second sticky note to create the merged sticky note, wherein merging of the first sticky note and the second sticky note would not be allowed prior to the feedback being given.