Adaptive inking in an electronic presentation system

• US 10,409,481 B2
• Filed: 06/06/2017
• Issued: 09/10/2019
• Est. Priority Date: 06/06/2017
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (HP Inc.)
• Inventors: Gao, Shu, Nimri, Alain
• Primary Examiner(s): Simpson, Lixi C
• Application Number:
  US15/615,664
• Publication Number:
  US 20180349016A1
• Time in Patent Office: 826 Days
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/32 Digital ink
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A presentation system capable of detecting one or more gestures and contacts on a touch sensitive display. The presentation system can displaying indicia of such contacts, such as when a user writes with a fingertip, and can remove or alter such indicia responsive to other gestures and contacts. The system can accurately distinguish between types of gestures detected, such as between a writing gesture and an erasing gesture, on both large and small touch sensitive displays, thereby obviating the need for a user to make additional selective inputs to transition from one type of gesture to another. The presentation system can distinguish between gestures appropriate for one type of writing and another. For example the system can determine that gestures correspond to writing in Chinese versus English, and display the writing in a style that is appropriate for that language.

Claims

1. A presentation system, the presentation system comprising:

at least one touch sensitive display, the at least one touch sensitive display having a display surface;

at least one processor coupled to the touch sensitive display; and

a memory storing instructions, the instructions comprising instructions executable by the processor to cause the touch sensitive display to;

detect a plurality of touch points within a time period, the time period having a predetermined length;

determine an average size of the touch points within the time period;

determine a standard deviation of the sizes of the touch points within the time period;

determine an average distance of the touch points from a predetermined line;

determine that the plurality of touch points corresponds to one or more writing gestures based on the average size, the standard deviation of the sizes, and the average distance of the touch points from the predetermined line;

determine a nature of the one or more writing gestures based on at least one factor;

determine a language group to which the one or more writing gestures correspond;

display, based on the determination that the plurality of touch points corresponds to one or more writing gestures and on the determination that the language group to which the one or more writing gestures correspond is a Roman group, one or more indicia on the touch sensitive display corresponding to the one or more writing gestures, wherein a thickness of the one or more indicia varies with a direction of the one or more writing gestures; and

display, based on the determination that the plurality of touch points corresponds to one or more writing gestures and on the determination that the language group to which the one or more writing gestures correspond is a Chinese-Japanese-Korean group, one or more indicia corresponding to the one or more writing gestures, wherein a thickness of the one or more indicia varies directly with an amount of time taken to make a writing gesture to which an indicium corresponds,

wherein a style in which the one or more indicia are displayed is based, at least in part, on the nature of the one or more writing gestures.

2. The presentation system of claim 1, wherein the at least one factor comprises a general direction of the one or more writing gestures along the touch sensitive display.

3. The presentation system of claim 1, wherein the at least one factor comprises a quantity of touch points included within the one or more writing gestures.

4. The presentation system of claim 1, wherein the at least one factor comprises a quantity of directional changes between one or more of the one or more writing gestures along the touch sensitive display.

5. The presentation system of claim 4, wherein the at least one factor further comprises a quantity of directional changes within one or more of the one or more writing gestures along the touch sensitive display.

6. The presentation system of claim 4, wherein the at least one factor further comprises a shape traced by one or more of the one or more writing gestures along the touch sensitive display.

7. A non-transitory computer readable medium storing instructions, the instructions comprising instructions executable by a processor to cause the processor to:

detect a plurality of touch gestures points at a touch sensitive display during a time period of predetermined length, the touch sensitive display including a display surface;

determine an average size of the touch points within the time period;

determine a standard deviation of the sizes of the touch points within the time period;

determine an average distance of the touch points from a predetermined line;

determine that the plurality of touch points corresponds to one or more writing gestures based on the average size, the standard deviation of the sizes, and the average distance of the touch points from the predetermined line;

determine a nature of the one or more writing gestures based on at least one factor;

determine a language group to which the one or more writing gestures correspond;

display, based on the determination that the plurality of touch points corresponds to one or more writing gestures and on the determination that the language group to which the one or more writing gestures correspond is a Roman group, one or more indicia on the display surface corresponding to the one or more writing gestures, wherein a thickness of the one or more indicia varies with a direction of the one or more writing gestures; and

display, based on the determination that the plurality of touch points corresponds to one or more writing gestures and on the determination that the language group to which the one or more writing gestures correspond is a Chinese-Japanese-Korean group, one or more indicia corresponding to the one or more writing gestures, wherein a thickness of the one or more indicia varies directly with an amount of time taken to make a writing gesture to which an indicium corresponds,

wherein a style in which the one or more indicia are displayed is based, at least in part, on the nature of the one or more writing gestures.

8. The non-transitory computer readable medium of claim 7, wherein the at least one factor comprises a general direction of the one or more writing gestures along the touch sensitive display.

9. The non-transitory computer readable medium of claim 7, wherein the at least one factor comprises a quantity of touch points included within the one or more writing gestures.

10. The non-transitory computer readable medium of claim 7, wherein the at least one factor comprises a quantity of directional changes between one or more of the one or more writing gestures along the touch sensitive display.

11. The non-transitory computer readable medium of claim 10, wherein the at least one factor further comprises a quantity of directional changes within one or more of the one or more writing gestures along the touch sensitive display.

12. The non-transitory computer readable medium of claim 10, wherein the at least one factor further comprises a shape traced by one or more of the one or more writing gestures along the touch sensitive display.

13. A computer implemented method for an electronic presentation system, the method comprising:

detecting, using a processor, a plurality of touch points at a touch sensitive device coupled to the processor, the touch sensitive device including a display surface;

determining, using the processor, an average size of the touch points;

determining, using the processor, a standard deviation of the sizes of the touch points;

determining, using the processor, an average distance of the touch points from a predetermined line;

determining, using the processor, that the plurality of touch points corresponds to one or more writing gestures based on the average size, the standard deviation of the sizes, and the average distance of the touch points from the predetermined line;

determining, using the processor, a nature of the one or more writing gestures based on at least one factor;

determining a language group to which the one or more writing gestures correspond;

displaying, based on the determination that the plurality of touch points corresponds to one or more writing gestures and on the determination that the language group to which the one or more writing gestures correspond is a Roman group, one or more indicia using the display surface under control of the processor, the one or more indicia corresponding to the one or more writing gestures, wherein a thickness of the one or more indicia varies with a direction of the one or more writing gestures,

wherein a style in which the one or more indicia are displayed is based, at least in part, on the nature of the one or more writing gestures.

14. The computer implemented method of claim 13, wherein the at least one factor comprises a general direction of the one or more writing gestures along the touch sensitive device.

15. The computer implemented method of claim 13, wherein the at least one factor comprises a quantity of touch points included within the one or more writing gestures.

16. The computer implemented method of claim 13, wherein the at least one factor comprises a quantity of directional changes between one or more of the one or more writing gestures along the touch sensitive device.

17. The computer implemented method of claim 16, wherein the at least one factor further comprises a quantity of directional changes within one or more of the one or more writing gestures along the touch sensitive device.

18. The computer implemented method of claim 16, wherein the at least one factor further comprises a shape traced by one or more of the one or more writing gestures along the touch sensitive device.

19. The computer implemented method of claim 13, wherein the touch sensitive device is a touch sensitive display.