METHOD AND SYSTEM FOR CREATING A VIEW-ANGLE DEPENDENT 2D AND/OR 3D IMAGE/VIDEO UTILIZING A MONOSCOPIC VIDEO CAMERA ARRAY

• US 20120050494A1
• Filed: 03/31/2011
• Published: 03/01/2012
• Est. Priority Date: 08/27/2010
• Status: Abandoned Application

• Current Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Original Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Inventors: Chen, Xuemin, Seshadri, Nambi, Karaoguz, Jeyhan, Boross, Chris
• Application Number:
  US13/077,922
• Publication Number:
  US 20120050494A1
• Time in Patent Office: Days
• US Class Current: 348/48
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence

Abstract

2D images and corresponding depth information are concurrently captured via an array of monoscopic sensing devices such as a monoscopic video camera array. The captured 2D images and the captured corresponding depth information are utilized to determine an image mapping function based on view angles. The captured 2D images and the captured corresponding depth information may be modified or adjusted to a given view angle through the determined image mapping function to compose a corresponding 3D image for the given view angle. Regression analysis may be performed to determine the image mapping function by fitting the captured 2D images and the captured corresponding depth information to known view angles of the monoscopic video camera array. 2D image data and corresponding depth information are determined for the given view angle utilizing the determined image mapping function so as to compose corresponding 2D and/or 3D images/video for the given view angle.

Claims

1. A method, comprising:

in an array of monoscopic sensing devices comprising one or more image sensors and one or more depth sensors;

concurrently capturing a plurality of two-dimensional images and corresponding depth information;

determining a function for two-dimensional image data and for corresponding depth information, based on view angles, utilizing said captured plurality of two-dimensional images and said captured corresponding depth information;

modifying said captured plurality of two-dimensional images and said captured corresponding depth information to a given view angle utilizing said determined function; and

composing a three-dimensional image for said given view angle utilizing said modified plurality of two-dimensional images and said modified corresponding depth information.

2. The method of claim 1, comprising modeling said captured plurality of two-dimensional images and said captured corresponding depth information to said function in terms of view angles.

3. The method of claim 2, comprising performing regression analysis on said captured plurality of two-dimensional images and said captured corresponding depth information in terms of view angles for said modeling.

4. The method of claim 3, comprising matching said captured plurality of two-dimensional images and said captured corresponding depth information to view angles of a plurality of monoscopic sensing devices of said array of monoscopic sensing devices during said regression analysis.

5. The method according to claim 3, comprising determining said function based on said regression analysis.

6. The method according to claim 5, comprising determining two-dimensional image data and corresponding depth information for said given view angle based on said determined function.

7. The method according to claim 6, comprising composing a two-dimensional image for said given view angle utilizing said determined two-dimensional image data.

8. The method according to claim 7, comprising rendering said composed two-dimensional image for said given view angle.

9. The method according to claim 6, comprising composing said three-dimensional image for said given view angle utilizing said determined two-dimensional image data and said determined corresponding depth information.

10. The method according to claim 7, comprising rendering said composed three-dimensional image for said given view angle.

11. A system for processing signals, the system comprising:

one or more processors and/or circuits for use in an array of monoscopic sensing devices comprising one or more image sensors and one or more depth sensors, wherein said one or more processors and/or circuits are operable to;

concurrently capture a plurality of two-dimensional images and corresponding depth information;

determine a function for two-dimensional image data and for corresponding depth information, based on view angles, utilizing said captured plurality of two-dimensional images and said captured corresponding depth information;

modify said captured plurality of two-dimensional images and said captured corresponding depth information to a given view angle utilizing said determined function; and

composing a three-dimensional image for said given view angle utilizing said modified plurality of two-dimensional images and said modified corresponding depth information.

12. The system according to claim 11, wherein said one or more circuits are operable to model said captured plurality of two-dimensional images and said captured corresponding depth information to said function in terms of view angles.

13. The system according to claim 12, wherein said one or more circuits are operable to perform regression analysis on said captured plurality of two-dimensional images and said captured corresponding depth information in terms of view angles for said modeling.

14. The system according to claim 13, wherein said one or more circuits are operable to match said captured plurality of two-dimensional images and said captured corresponding depth information to view angles of a plurality of monoscopic sensing devices of said array of monoscopic sensing devices during said regression analysis.

15. The system according to claim 13, wherein said one or more circuits are operable to determine said function based on said regression analysis.

16. The system according to claim 15, wherein said one or more circuits are operable to determine two-dimensional image data and corresponding depth information for said given view angle based on said determined function.

17. The system according to claim 16, wherein said one or more circuits are operable to compose a two-dimensional image for said given view angle utilizing said determined two-dimensional image data.

18. The system according to claim 17, wherein said one or more circuits are operable to render said composed two-dimensional image for said given view angle.

19. The system according to claim 16, wherein said one or more circuits are operable to compose said three-dimensional image for said given view angle utilizing said determined two-dimensional image data and said determined corresponding depth information.

20. The system according to claim 19, wherein said one or more circuits are operable to render said composed three-dimensional image for said given view angle.