RESIZING OF GESTURE-CREATED MARKINGS FOR DIFFERENT DISPLAY SIZES

• US 20120096345A1
• Filed: 10/19/2010
• Published: 04/19/2012
• Est. Priority Date: 10/19/2010
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Ho, Ronald, Grieve, Andrew A.
• Application Number:
  US12/907,473
• Publication Number:
  US 20120096345A1
• Time in Patent Office: Days
• US Class Current: 715/252
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/171 by use of digital ink

Abstract

Various embodiments are disclosed. According to one example embodiment, a method may include receiving a document at a first computing device having a display size that is different than a display size of a second computing device where a gesture-created marking was added to the document. The document may include the gesture-created image and a group of tagged characters. The method may further include adjusting a size or shape of the gesture-created marking in the document so that the gesture-created marking encompasses all tagged characters on the display of the first computing device. The adjusting may be performed based on the display size of the first computing device being different than display size of the second computing device.

Claims

1. An apparatus comprising:

at least one processor;

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor cause the apparatus to at least;

receive, by a first computing device having a first display with a first display size, a document that was edited or created on a second computing device having a second display with a second display size that is different from the first display size, the document including a gesture-created marking that encompassed a group of characters in the document when displayed on the second display, each of the characters encompassed by the gesture-created marking previously being tagged by the second computing device as being encompassed by the marking;

reflow, by the first computing device, at least characters of the document to accommodate the first display size; and

adjust, by the first computing device, based on the reflowing of the characters, a size or shape of the gesture-created marking in the document so that the gesture-created marking continues to encompass all tagged characters when displayed by the first computing device on the first display.

2. The apparatus of claim 1 wherein the first computing device comprises a mobile device and the second computing device comprises a computing device having a display with a display size that is larger than the display size of the mobile device.

3. The apparatus of claim 1 wherein the gesture-created marking comprises a hand-drawn marking drawn by a user of the second device using a finger or pointing device, the marking encompassing a group of characters of the document.

4. The apparatus of claim 1 wherein the gesture-created marking comprises an oval, circle, or polygon that encompasses the group of characters.

5. The apparatus of claim 1 wherein the apparatus being configured to adjust, by the first computing device, based on the reflowing of the characters, a size or shape of the gesture-created marking in the document comprises:

the apparatus being configured to increase, by the first computing device, a height of the marking relative to the width of the marking, to accommodate a reflowing of text onto the first display that has a line width or length that is shorter than the line width or length of the second display.

6. The apparatus of claim 1 wherein the apparatus being configured to adjust, by the first computing device, based on the reflowing of the characters, a size or shape of the gesture-created marking in the document comprises:

the apparatus being configured to increase, by the first computing device, a width of the marking relative to the height of the marking, to accommodate a reflowing of text onto the first display that have a line width or length that is longer than the line width or length of the second display.

7. The apparatus of claim 1 and the apparatus being further configured to:

adjust, by the first computing device, a size or shape of the gesture-created marking based on a deletion of characters from the group of characters or addition of characters between a first and last character of the group of characters

8. The apparatus of claim 1 and the apparatus being further configured to:

receive, by the first computing device, edits to at least the group of characters that were tagged, the edits including character deletions from the group or new characters added within the group; and

further adjust a size or shape of the gesture-created marking to encompass the edited group of characters.

9. The apparatus of claim 8 wherein the edits are performed at the second computing device, wherein at least the edited group of characters and the adjusted gesture-created marking being displayed substantially in real-time on at least the first display of the first computing device.

10. The apparatus of claim 8 wherein the edits are performed at the first computing device, wherein at least the edited group of characters and the adjusted gesture-created marking displayed on at least the first display of the first computing device.

11. A method comprising:

receiving, by a first computing device having a first display with a first display size, a document that was edited or created on a second computing device having a second display with a second display size that is different from the first display size, the document including a gesture-created marking that encompassed a group of characters in the document when displayed on the second display, each of the characters encompassed by the gesture-created marking previously being tagged by the second computing device as being encompassed by the marking;

reflowing, by the first computing device, at least characters of the document to accommodate the first display size; and

adjusting, by the first computing device, based on the reflowing of the characters, a size or shape of the gesture-created marking in the document so that the gesture-created marking continues to encompass all tagged characters when displayed by the first computing device on the first display.

12. A computer program product tangibly embodied on a computer-readable storage medium having executable-instructions stored thereon, the instructions being executable to cause a processor to:

receive, by a first computing device having a first display with a first display size, a document that was edited or created on a second computing device having a second display with a second display size that is different from the first display size, the document including a gesture-created marking that encompassed a group of characters in the document when displayed on the second display, each of the characters encompassed by the gesture-created marking previously being tagged by the second computing device as being encompassed by the marking;

reflow, by the first computing device, at least characters of the document to accommodate the first display size; and

adjust, by the first computing device, based on the reflowing of the characters, a size or shape of the gesture-created marking in the document so that the gesture-created marking continues to encompass all tagged characters when displayed by the first computing device on the first display.

13. A method comprising:

receiving a document at a first computing device having a display size that is different than a display size of a second computing device where a gesture-created marking was added to the document, the document including the gesture-created image and a group of tagged characters; and

adjusting a size or shape of the gesture-created marking in the document so that the gesture-created marking encompasses all tagged characters on the display of the first computing device, the adjusting being performed based on the display size of the first computing device being different than display size of the second computing device.

14. The method of claim 13 wherein the adjusting comprises:

reflowing at least characters of the document including the group of tagged characters based on the display size of the first computing device being different than display size of the second computing device; and

adjusting, based on the reflowing, a size or shape of the gesture-created marking in the document so that the gesture-created marking encompasses all tagged characters on the display of the first computing device.

15. A computer program product tangibly embodied on a computer-readable storage medium having executable-instructions stored thereon, the instructions being executable to cause a processor to:

receive a document at a first computing device having a display size that is different than a display size of a second computing device where a gesture-created marking was added to the document, the document including the gesture-created image and a group of tagged characters; and

adjust a size or shape of the gesture-created marking in the document so that the gesture-created marking encompasses all tagged characters on the display of the first computing device, the adjusting being performed based on the display size of the first computing device being different than display size of the second computing device.

16. A method comprising:

storing a gesture-created marking in a document that encompasses a group of characters in the document;

tagging each of the characters encompassed by the gesture-created marking;

receiving edits within the group of characters that were tagged, the edits including character deletions from the group or new characters added within the group;

tagging any new characters added to the group; and

adjusting a size or shape of the gesture-created marking to encompass the edited group of characters such that the adjusted gesture-created marking still encompasses all tagged characters.

17. The method of claim 16:

wherein the receiving edits comprises receiving new characters added between a first and last character of the group; and

wherein the tagging comprises tagging the new received characters; and

wherein the adjusting comprises adjusting a size or shape of the gesture-created image to encompass all tagged characters.

18. The method of claim 16:

wherein the receiving edits comprises receiving an indication of characters deleted between a first and last character of the group; and

wherein the adjusting comprising adjusting, based on the deleted characters, a size or shape of the gesture-created image to continue to encompass all tagged characters of the group.

19. The method of claim 16:

wherein the storing the gesture-created marking is performed by a first computing device having a first display size;

wherein the receiving the edits is performed by a second computing device having a second display size; and

the method further comprising further adjusting, by the second computing device, the size or shape of the gesture-created marking to account for the difference is display sizes between and first computing device and the second computing device.

22. The method of claim 18 wherein the storing comprises storing a marking drawn by a user that encompasses a group of characters based on movement of a user'"'"'s finger on a touch-sensitive display device.

24. The method of claim 18 wherein the storing comprises storing a marking drawn by a user via touch-sensitive display device that encompasses the group of characters;

and

wherein the adjusting comprises adjusting a size or shape of the marking based on user input via the touch-sensitive display device to move at least a portion of the marking

20. An apparatus comprising:

at least one processor; and

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor cause the apparatus to at least;

store a gesture-created marking in a document that encompasses a group of characters in the document;

tag each of the characters encompassed by the gesture-created marking;

receive edits within the group of characters that were tagged, the edits including character deletions from the group or new characters added within the group;

tag any new characters added to the group; and

adjust a size or shape of the gesture-created marking to encompass the edited group of characters such that the adjusted gesture-created marking still encompasses all tagged characters.

21. A method comprising:

storing, based on a first gesture by a user, a marking in a document that encompasses a group of characters in the document; and

adjusting a size or shape of the marking based on a second gesture from a user.

23. The method of claim 21, the adjusting including moving a portion of the gesture-created marking based on a motion of a user'"'"'s finger or other user input with respect to the gesture-created image to include additional characters within the marking or to exclude characters that were previously included within the marking.

25. An apparatus comprising:

at least one processor; and

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor cause the apparatus to at least;

store, based on a first gesture by a user, a marking in a document that encompasses a group of characters in the document; and

adjust a size or shape of the marking based on a second gesture from a user.

26. A method comprising:

storing a gesture-created marking in a document that encompasses a group of characters in the document; and

adjusting a size of the gesture-created marking to encompass at least one or more grammatical units of characters based on semantic analysis of at least a portion of the document.

27. The method of claim 26 wherein the grammatical units of characters are selected from the group consisting of:

a sentence;

multiple sentences;

a paragraph; and

multiple paragraphs.

28. The method of claim 26 wherein the adjusting comprises:

identifying a subject of a sentence that includes the group of characters; and

increasing a size of the gesture-created marking to encompass the sentence if the group of characters includes the subject.

29. The method of claim 26 wherein the adjusting comprises:

identifying a subject and a verb of a sentence that includes the group of characters; and

increasing a size of the gesture-created marking to encompass the sentence if the group of characters includes both the subject and verb.

30. The method of claim 26 wherein the adjusting comprises:

identifying one or more sentences that include at least one character of the group of characters; and

increasing a size of the gesture-created marking to include the one or more sentences.

31. The method of claim 26 wherein the adjusting comprises adjusting a size of the gesture-created marking to encompass at least all characters of a sentence if more than a specific percentage of characters of the sentence are within the group.

32. The method of claim 26 wherein the adjusting comprises adjusting a size of the gesture-created marking to encompass at least all characters of a paragraph if more than a specific percentage of characters of the paragraph are within the group.

33. The method of claim 26 wherein the adjusting comprises adjusting a size of the gesture-created marking to encompass at least all characters of a paragraph if more than a specific percentage of sentences of the paragraph are within the group.

34. An apparatus comprising:

at least one processor; and

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor cause the apparatus to at least;

store a gesture-created marking in a document that encompasses a group of characters in the document; and

adjust a size of the gesture-created marking to encompass at least one or more grammatical units of characters based on semantic analysis of at least a portion of the document.