Three-dimensional, 360-degree virtual reality camera system

• US 10,230,904 B2
• Filed: 04/11/2016
• Issued: 03/12/2019
• Est. Priority Date: 04/06/2016
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Cabral, Brian Keith, Briggs, Forrest Samuel, Hsu, Joyce, Pozo, Albert Parra, Coward, Andrew Hamilton
• Primary Examiner(s): Camargo, Marly S
• Application Number:
  US15/096,140
• Publication Number:
  US 20170295324A1
• Time in Patent Office: 1,065 Days
• Field of Search: 348 36, 348373-376, 348153, 348159, 348139, 348 38, 348 47, 348 48, 348264, 34833305, 34833304, 396419, 396424, 396535, 250239
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A camera system is configured to capture 360 degree image information of a local area, at least a portion of which is in stereo. The camera system includes a plurality of peripheral cameras, a plurality of axis cameras, a first rigid plate, and a second rigid plate, each aligned along an alignment axis. The peripheral cameras are arranged in a ring configuration that allows objects in the local area past a threshold distance to be within the fields of view of at least two peripheral cameras. The first and second rigid plates secure to a top and a bottom surface of the ring of peripheral cameras, respectively. At least one axis camera is arranged along the alignment axis and is coupled perpendicularly to a surface of the first rigid plate.

Claims

1. A camera system comprising:

a plurality of peripheral cameras, the peripheral cameras arranged in a ring configuration around a center point such that an optical axis of each camera is within a plane and a field of view of each camera faces away from the center point, and that outside of a threshold distance any object in a portion of a local area is within a field of view of at least two peripheral cameras;

at least one axis camera positioned such that an optical axis of the at least one axis camera is along an alignment axis that runs through the center point;

a first rigid plate positioned along the alignment axis such that the alignment axis bisects a center of the first plate, the first plate including a first top surface and a first bottom surface, the first top surface coupled to a first mounting surface of the at least one axis camera, wherein the at least one axis camera is vertically offset from the first top surface, the first bottom surface coupled to first mounting surfaces of the plurality of peripheral cameras; and

a second rigid plate positioned along the alignment axis such that the alignment axis bisects the center of the second plate, the second plate including a second top surface coupled to second mounting surfaces of the plurality of peripheral cameras.

2. The camera system of claim 1, wherein the first plate and the second plate are disk-shaped.

3. The camera system of claim 1, further comprising a bottom axis camera that is positioned such that an optical axis of the bottom axis camera is along the alignment axis that runs through the center point, and the center point is between a top axis camera and the bottom axis camera.

4. The camera system of claim 1, wherein the second plate includes a second bottom surface, and the camera system further comprising:

a support structure that is coupled to the second bottom surface, the support structure configured to support the camera system.

5. The camera system of claim 1, further comprising:

a camera controller configured to;

instruct the camera system to generate image information of the local area,

provide the image information to a processing server, wherein the processing server generates content using the image information, and the generated content includes a three-dimensional (3D) portion and a plurality of two-dimensional (2D) portions, the 3D portion corresponding to portions of the content generated using image information from the peripheral cameras and the 2D portion corresponding to portions of the content generated using image information from the at least one axis camera.

6. The camera system of claim 1, further comprising a plurality of axis cameras that include a first group of cameras positioned such that their respective optical axes are between the plane and the alignment axis, the first group of cameras having a total field of view that encompasses a second portion of the local area, and that outside of a second threshold distance any object in the second portion of the local area is within a field of view of at least two axis cameras in the first group of cameras.

7. The camera system of claim 1, wherein the at least one axis camera has a field of view that is larger than a field of view of each of the peripheral cameras.

8. A camera system comprising:

a plurality of peripheral cameras, the peripheral cameras arranged around a center point such that an optical axis of each camera is within a plane and a field of view of each camera faces away from the center point, and that outside of a threshold distance any object in a portion of a local area is within a field of view of at least two peripheral cameras;

at least one axis camera that is positioned such that an optical axis of the at least one axis camera is along an alignment axis that runs through the center point; and

a first rigid plate positioned along the alignment axis such that the alignment axis bisects a center of the first plate, the first plate including a first top surface and a first bottom surface, the first top surface coupled to a first mounting surface of the at least one axis camera, wherein the at least one axis camera is vertically offset from the first top surface, the first bottom surface coupled to first mounting surfaces of the plurality of peripheral cameras.

9. The camera system of claim 8, further comprising:

a second rigid plate positioned along the alignment axis such that the alignment axis bisects the center of the second plate, the second plate including a second top surface coupled to second mounting surfaces of the plurality of peripheral cameras.

10. The camera system of claim 9, wherein the first plate and the second plate are disk-shaped.

11. The camera system of claim 9, wherein the second rigid plate includes a second bottom surface, and the camera system further comprising:

a support structure that is coupled to the second bottom surface, the support structure configured to support the camera system.

12. The camera system of claim 9, further comprising a bottom axis camera coupled to the second bottom surface of the second rigid plate, and the bottom axis camera is positioned such that an optical axis of the bottom axis camera is along the alignment axis that runs through the center point, and the center point is between a top axis camera and the bottom axis camera.

13. The camera system of claim 8, further comprising:

a camera controller configured to;

instruct the camera system to generate image information of the local area, and

provide the image information to a processing server, wherein the processing server generates content using the image information, and the generated content includes a three-dimensional (3D) portion and a plurality of two-dimensional (2D) portions, the 3D portion corresponding to portions of the content generated using image information from the peripheral cameras and the 2D portion corresponding to portions of the content generated using image information from the at least one axis camera.

14. The camera system of claim 8, further comprising a plurality of axis cameras that include a first group of cameras positioned such that their respective optical axes are between the plane and the alignment axis, the first group of cameras having a total field of view that encompasses a second portion of the local area, and that outside of a second threshold distance any object in the second portion of the local area is within a field of view of at least two axis cameras in the first group of cameras.

15. The camera system of claim 8, wherein the at least one axis camera has a field of view that is larger than a field of view of each of the peripheral cameras.

16. A camera system comprising:

a plurality of peripheral cameras, the peripheral cameras arranged around a center point such that an optical axis of each camera is within a plane and a field of view of each camera faces away from the center point, and that outside of a threshold distance any object in a portion of a local area is within a field of view of at least two peripheral cameras;

a plurality of axis cameras including a top axis camera and a bottom axis camera, the top axis camera is positioned such that an optical axis of the top axis camera is along an alignment axis that runs through the center point, and the bottom axis camera is positioned such that an optical axis of the bottom axis camera is along the alignment axis that runs through the center point, and the center point is between the top axis camera and the bottom axis camera;

a first rigid plate positioned along the alignment axis such that the alignment axis bisects a center of the first plate, the first plate including a first top surface and a first bottom surface, the first top surface coupled to a first mounting surface of the top axis camera, wherein the top axis camera is vertically offset from the first top surface, the first bottom surface coupled to first mounting surfaces of the plurality of peripheral cameras; and

a second rigid plate positioned along the alignment axis such that the alignment axis bisects the center of the second plate, the second plate including a second top surface coupled to second mounting surfaces of the plurality of peripheral cameras.

17. The camera system of claim 16, wherein the second plate includes a second bottom surface, and the camera system further comprising:

a support structure that is coupled to the second bottom surface, the support structure configured to support the camera system.

18. The camera system of claim 17, further comprising a second bottom axis camera that is coupled to the second bottom surface of the second rigid plate, and the second bottom axis camera is positioned such that a second optical axis of the second bottom axis camera is parallel to the alignment axis that runs through the center point, and that the support structure is parallel to and in between the second optical axis and the alignment axis.

19. The camera system of claim 16, further comprising:

a camera controller configured to;

instruct the camera system to generate image information of the local area, and

provide the image information to a processing server, wherein the processing server generates content using the image information, and the generated content includes a three-dimensional (3D) portion and a plurality of two-dimensional (2D) portions, the 3D portion corresponding to portions of the content generated using image information from the peripheral cameras and the 2D portion corresponding to portions of the content generated using image information from the axis cameras.

20. The camera system of claim 16, wherein the plurality of axis cameras includes a first group of cameras positioned such that their respective optical axes are between the plane and the alignment axis, the first group of cameras having a total field of view that encompasses a second portion of the local area, and that outside of a second threshold distance any object in the second portion of the local area is within a field of view of at least two axis cameras in the first group of cameras.