Encoding A Depth Map Into An Image Using Analysis Of Two Consecutive Captured Frames

• US 20090066693A1
• Filed: 09/06/2007
• Published: 03/12/2009
• Est. Priority Date: 09/06/2007
• Status: Abandoned Application

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Carson, Roc
• Application Number:
  US11/851,170
• Publication Number:
  US 20090066693A1
• Time in Patent Office: Days
• US Class Current: 345/422
• CPC Class Codes: G06T 15/40 Hidden part removal
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

A computer implemented method of calculating and encoding depth data from captured image data is disclosed. In one operation, the computer implemented method captures two successive frames of image data through a single image capture device. In another operation, differences between a first frame of image data and a second frame of the image data are determined. In still another operation, a depth map is calculated when pixel data of the first frame of the image data is compared to pixel data of the second frame of the image data. In another operation, the depth map is encoded into a header of the first frame of image data.

Claims

1. A computer implemented method of calculating and encoding depth data from captured image data, comprising:

capturing two successive frames of image data through a single image capture device;

determining differences between a first frame of image data and a second frame of the image data;

calculating a depth map by comparing pixel data of the first frame of the image data to the second frame of the image data; and

encoding the depth map into a header of the first frame of image data.

2. The computer implemented method as in claim 1, further comprising generating a depth mask, wherein the differences between the first frame of image data and the second frame of image data are used to generate the depth mask.

3. The computer implemented method as in claim 1, further comprising identifying a plurality of depth planes, the depth planes based on changes in corresponding pixel data between the first frame of image data and the second frame of image data.

4. The computer implemented method as in claim 2, wherein the depth mask defines a plurality of depth planes.

5. The computer implemented method as in claim 2, wherein the depth mask is generated by comparing relative changes in pixel data for elements within the first frame of image data and corresponding elements within the second frame of image data.

6. The computer implemented method as in claim 1, wherein the differences between the first frame of image data and the second frame of image data are defined by pixel shifts of elements within the captured image data.

7. The computer implemented method as in claim 1, wherein the depth map is saved as a header to an image data file.

8. An image capture device configured to generate a depth map from captured image data comprising;

a camera interface;

an image storage controller interfaced with the camera interface, the image storage controller configured to store two successive frames of image data from the camera interface;

a depth mask capture module configured to create a depth mask based on differences between two successive frames of image data; and

a depth engine configured to process the depth mask to generate a depth map identifying a depth plane for elements in the captured image.

9. The image capture device as in claim 8, wherein the depth mask capture module includes logic configured to detect edges of elements within the image data based on the comparison of pixel data from corresponding locations between the two successive frames of image data.

10. The image capture device as in claim 8, wherein the depth mask capture module includes logic configured to compare corresponding pixel data between the two successive frames of image data.

11. The image capture device as in claim 10, wherein the logic that compares pixel data between the two successive frames of image data detects for relative pixel shifts of elements within the image data.

12. The image capture device as in claim 11, wherein corresponding pixel shifts above a threshold value are indicative of elements that are close to the camera interface.

13. The image capture device as in claim 11, wherein relatively smaller pixel shifts are indicative of elements that are further from the camera interface.

14. The image capture device as in claim 8, wherein the depth mask capture module outputs the depth mask, the depth mask includes multiple depth planes of elements within the image data.

15. The image capture device as in claim 8, wherein the depth engine includes logic configured to place elements in the captured image on depth planes based on the relative pixel shifts between the two successive frames of image data.

16. The image capture device as in claim 8, wherein the image data is manipulated in a post process procedure configured to apply the depth data so depth data is incorporated into displayed image data.

17. The image capture device as in claim 8, further comprising:

a memory configured to store the image data that includes the depth data.

18. The image capture device as in claim 17, wherein the image data is stored as compressed or uncompressed image data.

19. The image capture device as in claim 17, wherein the image data is stored in a header of the stored image data.