COMPLEXITY ESTIMATION OF A 2D/3D CONVERSION

• US 20130259318A1
• Filed: 12/08/2010
• Published: 10/03/2013
• Est. Priority Date: 12/08/2010
• Status: Active Grant

• Current Assignee: Thomson Licensing (Vantiva SA)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Barrett, Timothy Alan, Llach, Joan, Routhier, Pierre Hughes, Crosey, Ben
• Granted Patent: US 9,230,315 B2
• Time in Patent Office: Days
• US Class Current: 382/107
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00

Abstract

Automatic determination of the complexity associated with converting image content from 2-dimensions to 3-dimensions commences by first determining how many different scenes exist within the image content. Each scene then undergoes analysis to determine its complexity based on the motion, texture and occlusion within the scene. The scene complexities are added to the scene transition complexity and the total gets weighted to yield an overall indication of the complexity of converting of image content from 2-dimensions to 3-dimensions.

Claims

1. In an image pre-processor, a method for processing 2-dimensional image content having a plurality of scenes, comprising the steps of:

determining how many scenes exist within the image content;

determining complexity of each scene;

adding the scene complexities to a boundary complexity value to yield an overall complexity value indicative of the complexity of converting of image content from 2-dimensions to 3-dimensions;

undertaking calculation of the cost of conversion and likely success rate of the image content from 2-dimensions to 3-dimensions.

2. The method according to claim 1 wherein the step of determining how many scenes exist within the image content includes the steps of:

determining scene boundaries; and

determining scene durations.

3. The method according to claim 2 wherein the step of determining scene boundaries includes the steps of determining whether the difference between successive scenes exceeds a threshold value.

4. The method according to claim 1 wherein the boundary complexity value comprises a sum of the complexities of individual scene boundaries.

5. The method according to claim 4 wherein individual scene complexity is determined by determining motion and texture within the scene.

6. The method according to claim 5 wherein individual scene complexity further includes determining object occlusion within the scene.

7. The method according to claim 1 further comprising the step of automatically performing a limited 2D to 3D conversion of the image to generate a guide for subsequent manual 2D to 3D image conversion.

8. The method according to claim 4 wherein the boundary complexities are established contemporaneously with the scene complexities.

9. Apparatus for processing 2-dimensional image content having a plurality of scenes, comprising:

means for determining how many scenes exist within the image content;

means for determining complexity of each scene; and

means for adding to the scene complexities to a boundary complexity value to yield an overall complexity value indicative of the cost and likelihood of success of converting of image content from 2-dimensions to 3-dimensions.

10. The apparatus according to claim 9 further including

means for performing a limited 2D to 3D conversion of the image content to yield a guide for such conversion.

11. Apparatus for processing 2-dimensional image content having a plurality of scenes, comprising:

a content ingestion stage for receiving image content; and

a complexity determination stage for automatically determining a complexity value associated with of converting of image content from 2-dimensions to 3-dimensions.

12. The apparatus according to claim 11 wherein the content ingestion stage includes a film scanner for scanning a motion picture film to yield signals representative thereof.

13. The apparatus according to claim 11 wherein the content ingestion stage includes a content reader for image content stored on one of magnetic, optical or solid-state media.

14. The apparatus according to claim 11 wherein the complexity determination stage comprises a processor.

15. The apparatus according to claim 11 wherein the output stage includes a display device for providing a visual display of the complexity of the image content.

16. The apparatus according to claim 11 wherein the output stage further includes means for means for performing a limited 2D to 3D conversion of the image content to yield a guide for manual 2D to 3D conversion.