Image projection

• US 10,417,801 B2
• Filed: 11/13/2014
• Issued: 09/17/2019
• Est. Priority Date: 11/13/2014
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Tan, Kar-Han
• Primary Examiner(s): Chu, David H
• Application Number:
  US15/522,003
• Publication Number:
  US 20170316594A1
• Time in Patent Office: 1,769 Days
• Field of Search: None
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 10/421 by analysing segments intersecting the pattern
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 2013/0092 Image segmentation from stereoscopic image signals
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 9/3179 Video signal processing therefor
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

According to one example for outputting image data, an image comprising a surface and an object are captured on a sensor. An object mask based on the captured image is created on a processor. A first composite image based on the object mask and a source content file is created. In an example, the first composite image is projected to the surface.

Claims

1. A method of outputting image data, comprising:

capturing, on a sensor, an image comprising at least a surface and an object;

creating, on a processor, an object mask based on the captured image;

creating, on the processor, a first composite image based on the object mask and a source content file;

projecting, on a projector, the first composite image to the surface to form a projected first composite image;

capturing, on the sensor, an image of the object from the projected first composite image; and

combining the captured image of the object with content from the source content file to provide a second composite image.

2. The method according to claim 1, wherein an intensity of the first composite image is adjusted to a different value in an area corresponding to the object mask.

3. The method according to claim 1, further comprising capturing a third image, creating a second object mask and a third composite image, and projecting the third composite image.

4. The method according to claim 1, wherein the object mask is created by applying a plane fitting algorithm.

5. The method according to claim 1, wherein the object mask is created by comparing the captured image to the source content file.

6. The method of claim 1, further comprising:

generating a digital file comprising data representing the second composite image.

17. The method of claim 1, further comprising displaying the second composite image.

7. A system for outputting image data, comprising:

a camera attachable to a support structure to capture an image projected onto a surface and an object;

a projector attachable to the support structure; and

a processor communicatively coupled to the camera and the projector,

wherein the processor is to create an object mask based on the captured image and data associated with the captured object and create a first composite image of the object mask and a source content file,

wherein the projector is to project the first composite image to the surface to form a projected first composite image,

wherein the camera is to capture an image of the object from the projected first composite image, and

wherein the processor is to combine the image of the object with content from the source content file to provide a second composite image.

8. The system according to claim 7, wherein the projector comprises an adjustable intensity setting.

9. The system according to claim 8, wherein the adjustable intensity setting is adjusted based on the object mask.

10. The system according to claim 7, wherein the processor is to create an object mask by executing a plane fitting algorithm.

11. The system according to claim 7, wherein the processor is to create an object mask by comparing the captured image to the source content file.

12. The system of claim 7, further comprising:

a display to display the second composite image.

13. The system of claim 7, wherein the processor generates a digital file comprising data representing the second composite image.

14. A non-transitory computer readable storage medium on which is embedded a computer program, said computer program to output image data, said computer program comprising a set of instructions to:

capture, on a sensor, a first image projected onto a surface and an object;

create, on a processor, an object mask based on the captured image and the captured object and a first composite image based on the object mask and a source content file of the captured image;

project, on a projector, the first composite image to the surface to form a projected first composite image;

capture, on the sensor, an image of the object from the projected first composite image; and

combine the image of the object with content from the source content file to provide a second composite image.

15. The computer readable storage medium according to claim 14, wherein the second composite image is output to a display.

16. The computer readable storage medium according to claim 14, wherein the second composite image is output to a digital file.