Method and apparatus to reduce latency of touch events

• US 9,710,098 B2
• Filed: 03/19/2015
• Issued: 07/18/2017
• Est. Priority Date: 03/31/2014
• Status: Active Grant

• Current Assignee: Samsung Display Company Limited (Samsung Electronics Co. Ltd.)
• Original Assignee: Samsung Display Company Limited (Samsung Electronics Co. Ltd.)
• Inventors: Xiong, Wei, Seto, Frank
• Primary Examiner(s): Sharifi-Tafreshi, Koosha
• Application Number:
  US14/663,399
• Publication Number:
  US 20150277653A1
• Time in Patent Office: 852 Days
• Field of Search: 345173, 345174, 715863
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 11/203 Drawing of straight lines or curves
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A system includes: a touch path module to receive a plurality of touch events and to generate an output based on the touch events; and a rendering module to: receive a video image; receive the output of the touch path module; determine a plurality of points defining a boundary of a shape, the shape being determined based on the output of the touch path module; combine the video image with overlay data in accordance with the plurality of points to generate a combined display image; and output the combined display image.

Claims

1. A system comprising:

one or more integrated circuits configured to provide;

a touch path module to receive a plurality of touch events and to generate an output based on the touch events; and

a rendering module to;

receive a video image;

receive the output of the touch path module;

determine a plurality of points defining a boundary of a shape, the shape being determined based on the output of the touch path module;

generate a mask in accordance with the shape;

combine the video image with overlay data in accordance with the mask to generate a combined display image; and

output the combined display image,

wherein the combined display image comprises a plurality of rows,

wherein each of the points comprises a row coordinate,

the rendering module being further to;

classify the points as one or more of left-edge points and right-edge points;

sort the left-edge points by the row coordinate; and

sort the right-edge points by the row coordinate, and

the rendering module further, for a current row of the plurality of rows of the combined display image, to;

determine a start entry based on an left intersection between the current row and a left edge defined by a first left-edge point of the left-edge points and a second left-edge point of the left-edge points;

determine a stop entry based on a right intersection between the current row and a line defined by a first right-edge point of the right-edge points and a second right-edge point of the right-edge points;

generate a row mask comprising a plurality of entries for the current row based on the start entry and the stop entry; and

combine the video image with the overlay data for the current row in accordance with the row mask.

2. The system of claim 1, wherein the current row comprises a plurality of entries,

wherein each of the entries of the row mask has a first mask value or a second mask value,

the rendering module being further to, for each entry of the current row:

output the overlay data when a corresponding entry of the row mask has the first value; and

output the video image when the corresponding entry of the row mask has the second value.

3. The system of claim 2, wherein each of the entries of the row mask between the start entry and the stop entry has the first mask value.

4. The system of claim 1, further comprising a memory to store the left-edge points and the right-edge points in a lookup table.

5. The system of claim 1, wherein the rendering module is further to determine the plurality of points defining the boundary of the shape based on a line width parameter.

6. The system of claim 1, wherein the touch events comprise touch pressure information, and

wherein the rendering module is further configured to determine the plurality of points defining the boundary of the shape based on the touch pressure information.

7. A method for combining overlay data with a video image, the method comprising:

receiving the video image;

receiving a touch path from a touch path module;

determining a plurality of points defining a boundary of a shape, the shape being determined based on the touch path;

generating a mask in accordance with the shape;

combining the video image with the overlay data in accordance with the mask to generate a combined display image; and

outputting the combined display image

wherein the combined display image comprises a plurality of rows,

wherein each of the points comprises a row coordinate, and

wherein the method further comprises;

classifying the points as one or more of left-edge points and right-edge points;

sorting the left-edge points by the row coordinate;

sorting the right-edge points by the row coordinate;

determining a start entry for a current row of the rows based on a left intersection between the current row and a left edge defined by a first left-edge point of the left-edge points and a second left-edge point of the left-edge points;

determining a stop entry for the current row based on a right intersection between the current row and a right edge defined by a first right-edge point of the right-edge points and a second right-edge point of the right-edge points;

generating a row mask comprising a plurality of entries for the current row based on the start entry and the stop entry; and

combining the video image with the overlay data for the current row in accordance with the row mask.

8. The method of claim 7, wherein the current row comprises a plurality of entries,

wherein each of the entries of the row mask has a first mask value or a second mask value, and

wherein the combining the video image with the overlay data comprises,

outputting the overlay data when a corresponding entry of the row mask has the first value;

and

outputting the video image when the corresponding entry of the row mask has the second value.

9. The method of claim 8, wherein each of the entries of the row mask between the start entry and the stop entry has the first mask value.

10. The method of claim 7, further comprising storing the left-edge points and the right-edge points in a lookup table.

11. The method of claim 7, further comprising determining the plurality of points defining the boundary of the shape based on a line width parameter.

12. The method of claim 7, wherein the touch path comprises touch pressure information, and

wherein the method further comprises determining the plurality of points defining the boundary of the shape based on the touch pressure information.

13. A system comprising:

a touch panel;

a display panel; and

one or more integrated circuits configured to provide;

an application processor;

a touch path module to receive a plurality of touch events from the touch panel and to generate an output based on the touch events; and

a rendering module to;

receive a video image from the application processor;

receive the output of the touch path module;

determine a plurality of points defining a boundary of a shape, the shape being determined based on the output of the touch path module;

generate a mask in accordance with the shape;

combine the video image with overlay data in accordance with the mask to generate a combined display image; and

output the combined display image to the display panel,

wherein the combined display image comprises a plurality of rows,

wherein each of the points comprises a row coordinate,

the rendering module being further to;

classify the points as one or more of left-edge points and right-edge points;

sort the left-edge points by the row coordinate; and

sort the right-edge points by the row coordinate, and

the rendering module further, for a current row of the plurality of rows of the combined display image, to;

determine a start entry based on an left intersection between the current row and a left edge defined by a first left-edge point of the left-edge points and a second left-edge point of the left-edge points;

determine a stop entry based on a right intersection between the current row and a line defined by a first right-edge point of the right-edge points and a second right-edge point of the right-edge points;

generate a row mask comprising a plurality of entries for the current row based on the start entry and the stop entry; and

combine the video image with the overlay data for the current row in accordance with the row mask.

14. The system of claim 13, wherein the current row comprises a plurality of entries,

wherein each of the entries of the row mask has a first mask value or a second mask value,

the rendering module being further to, for each entry of the current row:

output the overlay data to the display panel when a corresponding entry of the row mask has the first value; and

output the video image to the display panel when the corresponding entry of the row mask has the second value,

wherein each of the entries of the row mask between the start entry and the stop entry has the first mask value.

15. The system of claim 13, further comprising a memory to store the left-edge points and the right-edge points in a lookup table.

16. The system of claim 13, wherein the rendering module is further to determine the plurality of points defining the boundary of the shape based on a line width parameter received from the application processor.

17. The system of claim 13, wherein the touch events comprise touch pressure information, and

wherein the rendering module is further configured to determine the plurality of points defining the boundary of the shape based on the touch pressure information.