Collaboration system with raster-to-vector image conversion

• US 10,013,631 B2
• Filed: 08/26/2016
• Issued: 07/03/2018
• Est. Priority Date: 08/26/2016
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Sklaroff, Jeff
• Primary Examiner(s): Yeh, Eueng-Nan
• Application Number:
  US15/249,064
• Publication Number:
  US 20180060689A1
• Time in Patent Office: 676 Days
• CPC Class Codes: G06T 11/203 Drawing of straight lines or curves
• CPC Class Codes: G06V 10/469 Contour-based spatial representations, e.g. vector-coding
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32

Abstract

A method for producing digital ink in a collaboration session between a first computing device and a second computing device that presents a digital canvas. In some embodiments, the method includes capturing a raster image of content using a camera operably coupled to the first computing device, deriving first image vectors and second image vectors based on first and second portions, respectively, of the raster image, sending the first image vectors to the second computing device for displaying a first digital ink object based on the first image vectors, and sending the second image vectors to the second computing device for displaying a second digital ink object based on the second image vectors after the displaying of the second digital ink object.

Claims

1. A method for producing digital ink in a collaboration session between a first computing device and a second computing device configured to present a digital canvas, the method comprising:

capturing a raster image of content using a camera operably coupled to the first computing device;

deriving first image vectors based on pixel data associated with a first portion of the raster image, and second image vectors based on pixel data associated with a second portion of the raster image, and defining an outline based on the pixel data of the first portion of the raster image and determining a plurality of contour segments along the outline;

sending the first image vectors to the second computing device for displaying a first digital ink object on the canvas based on the first image vectors; and

sending the second image vectors to the second computing device for displaying a second digital ink object on the canvas based on the second image vectors after the displaying of the first digital ink object.

2. The method of claim 1 further comprising receiving user feedback at the first computing device before sending the first image vectors, wherein deriving the first vectors includes re-deriving the first image vectors based on the user feedback.

3. The method of claim 2 wherein the re-deriving includes increasing a fidelity of the first image vectors to the first portion of the raster image.

4. The method of claim 3 wherein the re-deriving includes decreasing an amount of vectors used to represent the first portion of the raster image.

5. The method of claim 3 wherein the re-deriving includes recapturing an image of the content to be displayed.

6. The method of claim 5 wherein the recapturing includes adjusting an exposure level of the recaptured image relative to an exposure level of the raster image.

7. The method of claim 1, further comprising displaying the first digital ink object at a display of the first computing device while concurrently deriving the second image vectors.

8. The method of claim 1 further comprising receiving user feedback at the first computing device, wherein deriving the first image vectors includes deriving a number of Bezier curves based on the user feedback.

9. The method of claim 1 wherein the first computing device is a mobile device, and wherein the second computing device is an interactive display device.

10. A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform operations for providing a collaboration session at least between an interactive display device and a participant device, wherein the operations comprise:

capturing a raster image of content via a camera of the participant device;

deriving first image vectors based on a first portion of the image by defining an outline based on pixel data of the first portion of the raster image and determining a plurality of contour segments along the outline, and second image vectors based on a second portion of the image,

sending the first image vectors to the interactive display device for producing first digital ink corresponding to the first portion of the image; and

sending the second image vectors to the interactive display device for producing second digital ink corresponding to the second portion of the image.

11. The computer-readable storage medium of claim 10 wherein the operations further include receiving user feedback at the participant device before sending the first image vectors, wherein deriving the first vectors includes re-deriving the first image vectors based on the user feedback.

12. The computer-readable storage medium of claim 11 wherein the re-deriving includes one of increasing a fidelity of the first image vectors to the first portion of the raster image and decreasing an amount of vectors used to represent the first portion of the raster image.

13. The computer-readable storage medium of claim 11 wherein the re-deriving includes recapturing an image of the content to be displayed, and adjusting an imaging parameter of the recaptured image.

14. The computer-readable storage medium of claim 11 wherein the re-deriving includes deriving a number of Bezier curves based on the user feedback.

15. A computing system for providing a collaboration session, the system comprising a mobile device having a camera and configured to perform operations, including:

capturing a raster image of content via the camera;

deriving first image vectors based on a first portion of the image by defining an outline based on pixel data of the first portion of the raster image and determining a plurality of contour segments along the outline, and second vectors based on a second portion of the image;

sending the first image vectors to an interactive display device for producing first digital ink vectors at the interactive display device corresponding to the first portion of the image; and

sending the second image vectors to the interactive display device for producing second digital ink vectors at the interactive display device corresponding to the second portion of the image.

16. The computing system of claim 15 wherein the operations further include receiving user feedback at the mobile device before sending the first image vectors, wherein deriving the first image vectors includes re-deriving the first image vectors based on the user feedback.

17. The computing system of claim 16 wherein the re-deriving includes one of increasing a fidelity of the first image vectors to the first portion of the raster image and decreasing an amount of vectors used to represent the first portion of the raster image.

18. The computing system of claim 16 wherein the re-deriving includes recapturing an image of the content to be displayed, and adjusting an imaging parameter of the recaptured image.

19. The computing system of claim 16 wherein the re-deriving includes deriving a number of Bezier curves based on the user feedback.