Frame Linked 2D/3D Camera System

• US 20110085789A1
• Filed: 04/01/2010
• Published: 04/14/2011
• Est. Priority Date: 10/13/2009
• Status: Active Grant

• Current Assignee: James Cameron
• Original Assignee: James Cameron
• Inventors: Pace, Vincent, Campbell, Patrick
• Granted Patent: US 8,090,251 B2
• Time in Patent Office: Days
• US Class Current: 396/325
• CPC Class Codes: G03B 3/00 Focusing arrangements of general interest for cameras, projectors or printers
• CPC Class Codes: G03B 35/00 Stereoscopic photography
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

There is disclosed a method of operating a 3D camera and a frame-linked 2D/3D camera system. The 3D camera may receive data conveying operating parameters of at least one 2D camera. Operating parameters of the 3D camera including a pan angle Φ_3D, a tilt angle T_3D, a lens focal length FL_3D, and a lens focus distance FD_3D may be set based on, at least in part, the received data. An interocular distance IOD of the 3D camera may be set and a stereo convergence angle Θ of the 3D camera may be set based on IOD and FD_3D.

Claims

1. A method of operating a 3D camera to capture an image of a scene, comprising:

receiving data conveying operating parameters of at least one 2D camera

setting operating parameters of the 3D camera including a pan angle Φ

_3D, a tilt angle T_3D, a lens focal length FL_3D, and a lens focus distance FD_3D based on, at least in part, the received data

setting an interocular distance IOD of the 3D camera

setting a stereo convergence angle Θ

of the 3D camera based on IOD and FD_3D.

2. The method of operating a 3D camera of claim 1, wherein the received data conveys operating parameters of the 2D camera including one or more of a pan angle Φ

_2D, a tilt angle T_2D, a lens focal length FL_2D, and a lens focus distance FD_2D.

3. The method of operating a 3D camera of claim 1, wherein setting operating parameters of the 3D camera further comprises setting the lens focal length FL_3D based on, in part, a proportionality parameter K.

4. The method of operating a 3D camera of claim 3, wherein K defines a relative size of a 3D image frame to a 2D image frame.

5. The method of operating a 3D camera of claim 4, wherein K is predetermined.

6. The method of operating a 3D camera of claim 4, wherein K is variable and input by an operator.

7. The method of operating a 3D camera of claim 1, wherein setting operating parameters of the 3D camera further comprises setting the tilt angle T_3D based on, in part, a vertical offset parameter V.

8. The method of operating a 3D camera of claim 7, wherein V defines a vertical distance from the center of the 3D image frame to a center of the 2D image frame.

9. The method of operating a 3D camera of claim 8, wherein V is predetermined.

10. The method of operating a 3D camera of claim 8, wherein V is variable and input by an operator.

11. The method of operating a 3D camera of claim 1, wherein setting operating parameters of the 3D camera further comprises setting the pan angle Φ

_3D based on, in part, a horizontal offset parameter H.

12. The method of operating a 3D camera of claim 11, wherein H defines a horizontal distance from the center of the 3D image frame to a center of the 2D image frame.

13. The method of operating a 3D camera of claim 12, wherein H is predetermined.

14. The method of operating a 3D camera of claim 12, wherein H is variable and input by an operator.

15. The method of operating a 3D camera of claim 1, further comprising:

determining a relative location of the 3D camera with respect to the 2D camera.

setting the operating parameters based of the 3D camera based on, in part, the relation location of the 3D camera with respect to the 2D camera.

16. The method of operating a 3D camera of claim 1, wherein setting IOD further comprises:

setting IOD to one of a predetermined value and a value input by an operator.

17. The method of operating a 3D camera of claim 1, wherein setting IOD further comprises:

setting IOD automatically based on the operating parameters of the 2D camera and predetermined characteristics of the scene.

18. The method of operating a 3D camera of claim 17, wherein the predetermined characteristics of the scene include one or both of a distance from the 3D camera to the nearest foreground object and a distance from the 3D camera to a furthest background object.

19. The method of operating a 3D camera of claim 1, wherein

the at least one 2D camera is two 2D cameras each having a respective image frame

setting operating parameters of the 3D camera further comprises setting the lens focal length FL_3D to cause a 3D image frame to encompass 2D image frames of both 2D cameras.

20. A frame-linked 2D/3D camera system, comprising:

at least one 2D camera

a 3D camera comprising

a left camera and a right camera including respective left and right lenses plural mechanisms to set a pan angle (1)_3D, a tilt angle T_3D, an interocular distance IOD and a stereo convergence angle Θ

of the 3D camera and to set a focal length FL_3D and a focus distance FD_3D of the left and right lenses

a controller coupled to the at least one 2D camera and to the plural mechanisms of the 3D camera, the controller configured to

receive data indicating operating parameters of the at least one 2D camera

set operating parameters of the 3D camera including the pan angle Φ

_3D, the tilt angle T_3D, the lens focal length FL_3D, and the lens focus distance FD_3D based on, at least in part, the received data

set the interocular distance IOD of the 3D camera

set a stereo convergence angle Θ

of the 3D camera based on IOD and FD_3D.

21. The frame-linked 2D/3D camera system of claim 20, wherein the received data conveys operating parameters of the 2D camera including one or more of a pan angle Φ

_2D, a tilt angle T_2D, a lens focal length FL_2D, and a lens focus distance FD_2D.

22. The frame-linked 2D/3D camera system of claim 20, wherein the controller is configured to set FL_3D based on, in part, a proportionality parameter K.

23. The frame-linked 2D/3D camera system of claim 22, wherein K defines a relative size of a 3D image frame to a 2D image frame.

24. The frame-linked 2D/3D camera system of claim 23, wherein K is predetermined.

25. The frame-linked 2D/3D camera system of claim 23, wherein K is variable and input by an operator.

26. The frame-linked 2D/3D camera system of claim 20, wherein the controller is configured to set T_3D based on, in part, a vertical offset parameter V.

27. The frame-linked 2D/3D camera system of claim 26, wherein V defines a vertical distance from the center of the 3D image frame to a center of the 2D image frame.

28. The frame-linked 2D/3D camera system of claim 27, wherein V is predetermined.

29. The frame-linked 2D/3D camera system of claim 27, wherein V is variable and input by an operator.

30. The frame-linked 2D/3D camera system of claim 20, wherein the controller is configured to set Φ

_3D based on, in part, a horizontal offset parameter H.

31. The frame-linked 2D/3D camera system of claim 30, wherein H defines a horizontal distance from the center of the 3D image frame to a center of the 2D image frame.

32. The frame-linked 2D/3D camera system of claim 31, wherein H is predetermined.

33. The frame-linked 2D/3D camera system of claim 31, wherein H is variable and input by an operator.

34. The frame-linked 2D/3D camera system of claim 20, wherein the controller is further configured to set the operating parameters of the 3D camera based on, in part, a predetermined relative location of the 3D camera with respect to the 2D camera.

35. The frame-linked 2D/3D camera system of claim 20, wherein the controller is configured to set IOD to one of a predetermined value and a value input by an operator.

36. The frame-linked 2D/3D camera system of claim 20, wherein the controller is configured to set IOD automatically based on the operating parameters of the 2D camera and predetermined characteristics of the scene.

37. The frame-linked 2D/3D camera system of claim 36, wherein the predetermined characteristics of the scene include one or both of a distance from the 3D camera to the nearest foreground object and a distance from the 3D camera to a furthest background object.

38. The frame-linked 2D/3D camera system of claim 20, wherein

the at least one 2D camera is two 2D cameras each having a respective image frame

the controller is configured to set the lens focal length FL_3D to cause a 3D image frame to encompass 2D image frames of both 2D cameras.

39. A computing device, comprising:

a processor

memory coupled to the processor

a 2D camera interface for connection to at least one 2D camera

a 3D camera interface for connection to a 3D camera

a storage device coupled to the processor, the storage device storing instructions which, when executed by the processor, cause the computing device to perform actions including;

receiving, via the 2D camera interface, data conveying operating parameters of the at least one 2D camera

sending, via the 3D camera interface, data to set operating parameters of the 3D camera including a pan angle Φ

_3D, a tilt angle T_3D, a lens focal length FL_3D, and a lens focus distance FD_3D based on, at least in part, the received data

sending, via the 3D camera interface, data to set an interocular distance IOD of the 3D camera

sending, via the 3D camera interface, data to set a stereo convergence angle Θ

of the 3D camera based on IOD and FD_3D.