Method and apparatus for optimizing capture device settings through depth information

• US 8,085,339 B2
• Filed: 12/23/2009
• Issued: 12/27/2011
• Est. Priority Date: 01/16/2004
• Status: Expired due to Term

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Marks, Richard L.
• Primary Examiner(s): Ho, Tuan
• Assistant Examiner(s): WANG, KENT F
• Application Number:
  US12/646,938
• Publication Number:
  US 20100097476A1
• Time in Patent Office: 734 Days
• Field of Search: 348/370, 348/347, 348/208.12, 348/208.14, 348/229.1, 348/231.6, 348/345, 348/352, 348/362, 348/363, 348/364, 345501-503, 345/522
• US Class Current: 348/362
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 5/2226 Determination of depth image, e.g. for foreground/background separation determining depth by image analysis in general G06T7/50; segmentation by image analysis in general G06T7/10
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A method for adjusting image capture settings for an image capture device is provided. The method initiates with capturing depth information of a scene at the image capture device. Depth regions are identified based on the captured depth information. Then, an image capture setting is adjusted independently for each of the depth regions. An image of the scene is captured with the image capture device, wherein the image capture setting is applied to each of the depth regions when the image of the scene is captured.

Claims

1. A method for adjusting image capture settings for an image capture device, comprising:

capturing depth information of a scene at the image capture device, the depth information identifying objects at various depths from the image capture device within the scene;

identifying depth regions of different depths based on the captured depth information;

adjusting an image capture setting independently for each of the depth regions; and

performing a single capture of an image of the scene with the image capture device, the image capture device applying the image capture setting of each of the depth regions when the image of the scene is captured;

wherein the depth information consists of a depth mask, the depth mask containing a plurality of bit values for a plurality of pixels which define the captured image of the scene, each bit value corresponding to one of the depth regions.

2. The method of claim 1, wherein the captured depth information consists of depth values for a plurality of pixels which define the captured image of the scene.

3. The method of claim 1, wherein the identified objects at various depths define the depth regions, the depth regions including one or more foreground regions and a background region.

4. The method of claim 1, further comprising

capturing successive images of the scene with the image capture device, the image capture device applying the independently adjusted image capture setting, the independent adjustment of the image capture setting being performed at a periodic interval of the successive images of the scene.

5. The method of claim 4, further comprising

tracking an object within one of the depth regions, the tracking being enhanced by the applied adjusted image capture setting.

6. The method of claim 5, wherein the applied adjusted image capture setting enhances the tracking of the object within the one of the depth regions by reducing brightness of another depth region.

7. The method of claim 1, wherein the image capture setting is selected from the group consisting of gain, exposure, or brightness.

8. The method of claim 1, wherein the independent adjustment of the image capture setting for each depth region is performed according to the bit values of the depth mask.

9. An image capture device, comprising:

depth capturing logic for capturing depth information of a scene at the image capture device, the depth information identifying objects at various depths from the image capture device within the scene, the depth capturing logic further configured to identify depth regions of different depths based on the captured depth information;

image capture logic configured to adjust an image capture setting of the image capture device independently for each of the depth regions, and to perform a single capture of an image of the scene, the image capture logic further configured to apply the image capture setting to the capturing of the image of the scene; and

tracking logic configured to track an object within one of the depth regions;

wherein the application of the image capture setting enhances the tracking.

10. The image capture device of claim 9, wherein the application of the image capture setting enhances tracking of the object within the one of the depth regions by reducing brightness of another depth region.

11. A method for adjusting frame capture settings for a video capture device, comprising:

capturing depth information of a scene at the video capture device, the depth information identifying depth regions of different depths based on one or more objects at various depths within the scene;

adjusting a frame capture setting independently for each of the depth regions; and

capturing successive frames of the scene with the video capture device, the video capture device applying the frame capture setting of each of the depth regions when each of the successive frames of the scene are captured; and

tracking an object within one of the depth regions, the tracking being enhanced by the applied adjusted frame capture setting;

wherein the independent adjustment of the frame capture setting is performed at a periodic interval of the successive frames of the scene.

12. The method of claim 11, wherein the applied adjusted image capture setting enhances the tracking of the object within the one of the depth regions by reducing brightness of another depth region.

13. A method for adjusting image capture settings for an image capture device, comprising:

capturing depth information of a scene at the image capture device, the depth information identifying objects at various depths from the image capture device within the scene;

identifying depth regions of different depths based on the captured depth information;

adjusting an image capture setting independently for each of the depth regions; and

performing a single capture of an image of the scene with the image capture device, the image capture device applying the image capture setting of each of the depth regions when the image of the scene is captured;

capturing successive images of the scene with the image capture device, the image capture device applying the independently adjusted image capture setting to each of the successive images of the scene, the independent adjustment of the image capture setting being performed at a periodic interval of the successive images of the scene; and

tracking an object within one of the depth regions, the tracking being enhanced by the applied adjusted image capture setting.

14. The method of claim 13, wherein the applied adjusted image capture setting enhances the tracking of the object within the one of the depth regions by reducing brightness of another depth region.