Paper Strip Presentation of Grouped Content

• US 20160179225A1
• Filed: 01/22/2016
• Published: 06/23/2016
• Est. Priority Date: 10/24/2013
• Status: Abandoned Application

• Current Assignee: Livescribe Incorporated (Anoto Group AB)
• Original Assignee: Livescribe Incorporated (Anoto Group AB)
• Inventors: Black, David Robert, Halle, Brett Reed
• Application Number:
  US15/004,876
• Publication Number:
  US 20160179225A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/23 Clustering techniques
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 10/762 using clustering, e.g. of similar faces in social networks
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/347 Sampling; Contour coding; Stroke extraction

Abstract

A system and a method are disclosed for displaying content collected in a pen-based computing system. Content collected in the pen-based computing system includes stroke data collected by a smart pen as well as other contextual data collected by the pen-based computing system. The collected stroke data are grouped into snippets and used to create paper strips. Paper strips are arranged based on metadata associated with the collected content.

Claims

1. A method for displaying content collected in a pen-based computing system, the method comprising:

obtaining a plurality of stroke data representing strokes made by a smart pen with respect to a writing surface;

grouping the plurality of stroke data into one or more snippets based on temporal and spatial coordinates of the stroke data, each snippet having associated metadata;

creating a plurality of paper strips, by a processor, each paper strip corresponding to a different snippet, and each paper strip representing the stroke data of the corresponding snippet;

arranging the plurality of the created paper strips based on the associated metadata of the snippets corresponding to the paper strips; and

outputting the created one or more paper strips.

2. The method of claim 1, further comprising:

determining an orientation of the stroke data in a given paper strip based on spatial coordinates and timestamps associated with the stroke data in a corresponding snippet; and

orienting the given paper strip based on the determined orientation.

3. The method of claim 1, wherein in the associated metadata comprises at least one of:

a timestamp, a positional coordinate, a contextual marker, location information, device identity, and text recognized from strokes using handwriting recognition.

4. The method of claim 1, wherein creating the plurality of paper strips further comprises:

for a given paper strip corresponding to a first snippet having first stroke data, including in the given paper strip second stroke data having vertical coordinates that overlap with vertical coordinates of stroke data in the first snippet.

5. The method of claim 1, wherein the metadata associated with each snippet includes a timestamp, and wherein arranging the plurality of the created paper strips comprises:

arranging the plurality of the created paper strips based on a sequential ordering of the timestamp in each of the created paper strips.

6. The method of claim 1, further comprising:

displaying first stroke data of a first snippet in a first paper strip;

converting the first stroke data to one or more characters based on handwriting recognition of the first stroke data;

receiving an input to toggle the first paper strip; and

responsive to the input, displaying a representation of the one or more characters converted from the first stroke data.

7. The method of claim 1, further comprising:

linking one or more contextual data items collected by the pen-based computing system to the created paper strip; and

modifying the created paper strip to further comprise one or more references to the linked one or more contextual data items.

8. The method of claim 7, wherein the contextual data items comprise at least one of:

a contextual marker, a command, a photograph, location information, an audio recording, a video recording, a web page, a calendar entry, a contact entry, an email, and a document.

9. The method of claim 7, wherein the one or more references are displayed as an object comprising at least one of:

an image, an image preview, a video preview, an icon, and a text preview.

10. The method of claim 7, further comprising:

receiving an input designating a first paper strip and an associated item in a second paper strip, the associated item comprising at least one of stroke data and a contextual item;

modifying the first paper strip to include the associated item;

modifying the second paper strip to remove the associated item; and

displaying the modified first paper strip and the modified second paper strip.

11. The method of claim 7, further comprising:

receiving an input designating a filter based on a contextual data item;

re-arranging the plurality of paper strips to sort the plurality of paper strips based on the contextual data item; and

displaying the re-arranged plurality of paper strips.

12. The method of claim 7, further comprising:

receiving an input selecting a reference included in a displayed paper strip; and

responsive to receiving an input selecting a reference, displaying the contextual data item linked to the reference.

18. The non-transitory, computer readable storage medium of claim 12, further comprising instructions that cause the processor to:

display a first stroke data of a first snippet in a first paper strip;

convert the first stroke data to one or more characters based on handwriting recognition of the first stroke data;

receive an input to toggle the first paper strip; and

responsive to the input, display a representation of the one or more characters converted from the first stroke data.

19. The non-transitory, computer readable storage medium of claim 12, further comprising instructions that cause the processor to:

link one or more contextual data items collected by the pen-based computing system to the created paper strip; and

modify the created paper strip to further comprise one or more references to the linked one or more contextual data items.

20. The non-transitory, computer readable storage medium of claim 19, wherein the contextual data items comprise at least one of:

a contextual marker, a command, a photograph, location information, an audio recording, a video recording, a web page, a calendar entry, a contact entry, an email, and a document.

21. The non-transitory, computer readable storage medium of claim 19, wherein the one or more references are displayed as an object comprising at least one of:

an image, an image preview, a video preview, an icon, and a text preview.

22. The non-transitory, computer readable storage medium of claim 19, further comprising instructions that cause the processor to:

receive an input designating a first paper strip and an associated item in a second paper strip, the associated item comprising at least one of stroke data and a contextual item;

modify the first paper strip to include the associated item;

modify the second paper strip to remove the associated item; and

display the modified first paper strip and the modified second paper strip.

23. The non-transitory, computer readable storage medium of claim 19, further comprising instructions that cause the processor to:

receive an input designating a filter based on a contextual data item;

re-arrange the plurality of paper strips to sort the plurality of paper strips based on the contextual data item; and

display the re-arranged plurality of paper strips.

24. The non-transitory, computer readable storage medium of claim 19, further comprising instructions that cause the processor to:

receive an input selecting a reference included in a displayed paper strip; and

responsive to receiving an input selecting a reference, display the contextual data item linked to the reference.

13. A non-transitory, computer-readable storage medium configured to store instructions, the instructions when executed by a processor cause the processor to:

obtain, by a processor of the pen-based computing system, a plurality of stroke data representing strokes made by a smart pen with respect to a writing surface;

group the plurality of stroke data into one or more snippets based on temporal and spatial coordinates of the stroke data, each snippet having associated metadata;

create a plurality of paper strips, each paper strip corresponding to a different snippet, and each paper strip representing the stroke data of the corresponding snippet;

arrange the plurality of created paper strips based on the associated metadata of the snippets corresponding to the paper strips; and

prepare for display the created one or more paper strips.

14. The non-transitory, computer readable storage medium of claim 13, further comprising instructions that cause the processor to:

determine an orientation of the stroke data in a given paper strip based on spatial coordinates and timestamps associated with the stroke data in a corresponding snippet; and

orient the given paper strip based on the determined orientation.

15. The non-transitory, computer readable storage medium of claim 13, wherein in the associated metadata comprises at least one of:

a timestamp, a positional coordinate, a contextual marker, location information, device identity, and text recognized from strokes using handwriting recognition.

16. The non-transitory, computer readable storage medium of claim 13, further comprising instructions that cause the processor to:

for a given paper strip corresponding to a first snippet having first stroke data, include in the given paper strip second stroke data having vertical coordinates that overlap with vertical coordinates of stroke data in the first snippet.

17. The non-transitory, computer readable storage medium of claim 13, wherein the metadata associated with each snippet includes a timestamp, and wherein the instructions to arrange the plurality of the created paper strips comprise instructions that cause the processor to:

arrange the plurality of the created paper strips based on a sequential ordering of the timestamp in each of the created paper strips.