Method and system for ink data generation, ink data rendering, ink data manipulation and ink data communication

• US 9,904,466 B2
• Filed: 07/19/2016
• Issued: 02/27/2018
• Est. Priority Date: 11/19/2013
• Status: Active Grant

• Current Assignee: Wacom Co Limited (Wacom)
• Original Assignee: Wacom Co Limited (Wacom)
• Inventors: Angelov, Branimir, Petkov, Plamen
• Primary Examiner(s): McDowell, Jr., Maurice L
• Application Number:
  US15/213,651
• Publication Number:
  US 20160328625A1
• Time in Patent Office: 588 Days
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0447 Position sensing using the local deformation of sensor cells
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 10/101 Collaborative creation, e.g. joint development of products or services
• CPC Class Codes: G06T 11/203 Drawing of straight lines or curves
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/347 Sampling; Contour coding; Stroke extraction

Abstract

Methods and systems are provided for generating, rendering, manipulating (e.g., slicing), and communicating stroke objects that form ink data. In a method of generating a stroke object, pen event data indicative of pen down, pen movement, and pen up events are sequentially received to generate point objects that collectively form a stroke object. The point objects serve as control points for interpolating curve segments. Further, a start parameter indicative of a start point within a starting curve segment of the curve segments at which display of the stroke object starts, and an end parameter indicative of an end point within an ending curve segment of at which display of the stroke object ends, are generated for the stroke object. When rendering the stroke object, a system limits display of the stroke object to a range bound by the start and end parameters, as opposed to displaying the entire stroke object.

Claims

1. A method of manipulating pre-existing ink data in a memory of a device including an input sensor to generate new ink data, comprising:

receiving input information including coordinates data from the input sensor;

receiving manipulation information indicating whether the input information is configured to transform the pre-existing stroke object of the ink data;

selecting a part or a full of a target stroke object to be transformed if a stroke path formed by the coordinates data included in the input information intersects the target stroke object; and

when the manipulation information indicates that the input information is configured to slice the pre-existing stroke object, slicing the selected target stroke object at an intersected section to generate two slice objects from the selected target stroke object, wherein

the two slice objects provide modification to divide the pre-existing stroke object into two new stroke objects; and

each of the two slice objects includes a start parameter indicative of a start point within a starting curve segment of the curve segments at which display of the slice object starts and an end parameter indicative of an end point within an ending curve segment of the curve segments at which display of the slice object ends when the two new stroke objects generated by finalizing the two slice object are rendered.

2. The method of claim 1, wherein each of the two slice objects includes:

an index of a point object in the pre-existing stroke object indicating a start point object of the slice object, wherein the index is a control point index used to maintain the shape of the starting curve segment before and after the manipulation; and

an index of a point object in the pre-existing stroke object indicating an end point object of the slice object, wherein the index is a control point index used to maintain the shape of the ending curve segment before and after the manipulation.

3. The method of claim 2, wherein said slicing step includes:

determining a cross-point at which the selected target stroke object is sliced;

determining a new end point within an ending curve segment of a first slice object based on the determined cross-point; and

determining a new start point within a starting curve segment of a second slice object based on the determined cross-point.

4. The method of claim 3, wherein

the input information configured to slice a pre-existing stroke object is a stroke object having a width such that said stroke object intersects the selected target stroke at a first cross-point and a second cross-point;

the step of determining the new end point of the first slice object includes determining the first cross-point as the new end point; and

the step of determining the new start point of the second slice object includes determining the second cross-point as the new start point.

5. The method of claim 4, wherein the slicing operation is used in an eraser application to erase a portion of the pre-existing stroke having the width.

6. The method of claim 5, further comprising:

determining whether the ink data including the pre-existing stroke is shared by a remote computer; and

if it is determined that the ink data is shared by the remote computer, transmitting to the remote computer the information to slice the pre-existing stroke object existent in a memory of the remote computer to two new stroke objects in a message.

7. The method of claim 6, wherein the information to slice is selected from a group consisting of:

a slicing stroke object used for the slicing;

two slice objects resulting from the slicing;

a hole segment object resulting from the slicing; and

two new stroke objects generated from the two slice objects.

8. The method of claim 6, wherein in case the remote computer is incapable of carrying out the slicing operation, transmitting to the remote computer the two stroke objects resulting from finalizing the two slice objects.

9. A non-transitory computer readable medium including processor-executable instructions which, when loaded onto a processor, causes the processor to execute a process of manipulating pre-existing ink data in a memory, wherein the process comprises:

receiving input information including coordinates data from an input sensor configured to generate new ink data;

receiving manipulation information indicating whether the input information is configured to transform the pre-existing stroke object of the ink data;

selecting a part or a full of a target stroke object to be transformed if a stroke path formed by the coordinates data included in the input information intersects the target stroke object; and

when the manipulation information indicates that the input information is configured to slice the pre-existing stroke object, slicing the selected target stroke object at an intersected section to generate two slice objects from the selected target stroke object, wherein

the two slice objects provide modification to divide the pre-existing stroke object into two new stroke objects; and

each of the two slice objects includes a start parameter indicative of a start point within a starting curve segment of the curve segments at which display of the slice object starts and an end parameter indicative of an end point within an ending curve segment of the curve segments at which display of the slice object ends when the two new stroke objects generated by finalizing the two slice object are rendered.

10. The computer readable medium of claim 9, wherein each of the two slice objects includes:

an index of a point object in the pre-existing stroke object indicating a start point object of the slice object, wherein the index is a control point index used to maintain the shape of the starting curve segment before and after the manipulation; and

an index of a point object in the pre-existing stroke object indicating an end point object of the slice object, wherein the index is a control point index used to maintain the shape of the ending curve segment before and after the manipulation.

11. The computer readable medium claim 10, wherein said slicing step includes:

determining a cross-point at which the selected target stroke object is sliced;

determining a new end point within an ending curve segment of a first slice object based on the determined cross-point; and

determining a new start point within a starting curve segment of a second slice object based on the determined cross-point.

12. The computer readable medium of claim 11, wherein

the input information configured to slice a pre-existing stroke object is a stroke object having a width such that said stroke object intersects the selected target stroke at a first cross-point and a second cross-point;

the step of determining the new end point of the first slice object includes determining the first cross-point as the new end point; and

the step of determining the new start point of the second slice object includes determining the second cross-point as the new start point.

13. The computer readable medium of claim 12, wherein the slicing operation is used in an eraser application to erase a portion of the pre-existing stroke having the width.

14. The computer readable medium of claim 13, wherein the process further comprises:

determining whether the ink data including the pre-existing stroke is shared by a remote computer; and

if it is determined that the ink data is shared by the remote computer, transmitting to the remote computer the information to slice the pre-existing stroke object existent in a memory of the remote computer to two new stroke objects in a message.

15. The computer readable medium of claim 14, wherein the information to slice is selected from a group consisting of:

a slicing stroke object used for the slicing;

two slice objects resulting from the slicing;

a hole segment object resulting from the slicing; and

two new stroke objects generated from the two slice objects.

16. The computer readable medium of claim 14, wherein in case the remote computer is incapable of carrying out the slicing operation, transmitting to the remote computer the two stroke objects resulting from finalizing the two slice objects.