MOBILE DEVICE AND SYSTEM FOR GENERATING PANORAMIC VIDEO

• US 20140347439A1
• Filed: 08/23/2013
• Published: 11/27/2014
• Est. Priority Date: 05/22/2013
• Status: Abandoned Application

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Jia, Zhen, Huang, Lili
• Application Number:
  US13/974,229
• Publication Number:
  US 20140347439A1
• Time in Patent Office: Days
• US Class Current: 348/36
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A system and mobile device for generating a panoramic video is presented. The system comprises a plurality of cameras and a mobile device. The mobile device further comprises a CPU and a GPU. The plurality of cameras is operable to capture video frames from different directions through 360° to generate multi-channel video streams. The CPU is configured to issue to the GPU an instruction to process the multi-channel video streams. The GPU is configured to mosaic synchronous video frames of the multi-channel video streams by utilizing parallel computing according to the instruction, so as to generate the panoramic video in real time.

Claims

1. A system for generating a panoramic video, including a plurality of cameras and a mobile device, the mobile device further including a central processing unit and a graphics processing unit,

wherein the plurality of cameras are operable to capture video frames from different directions through 360°

to generate multi-channel video streams;

wherein the central processing unit is configured to issue to the graphics processing unit an instruction to process the multi-channel video streams; and

wherein the graphics processing unit is configured to mosaic synchronous video frames of the multi-channel video streams by utilizing parallel computing according to the instruction, so as to generate the panoramic video in real time.

2. The system according to claim 1, wherein the graphics processing unit is further configured to mosaic the synchronous video frames based on Compute Unified Device Architecture.

3. The system according to claim 1, wherein the plurality of cameras are integrated in the mobile device, wherein each of the plurality of cameras includes a CMOS sensor interface for transferring a corresponding video stream of the multi-channel video streams to the graphics processing unit.

4. The system according to claim 3, wherein the plurality of cameras are arranged on the same plane parallel to a top surface of the mobile device.

5. The system according to claim 1, wherein the plurality of cameras are integrated in an individual video recording module, and the video recording module further includes a USB interface for being connected to a USB interface of the mobile device.

6. The system according to claim 5, wherein the resolutions of and the refresh rates of the plurality of cameras are determined based on the bandwidth of the USB interface of the video recording module.

7. The system according to claim 5, wherein the plurality of cameras are arranged on the same plane parallel to a top surface of the mobile device when the video recording module is connected to the mobile device.

8. The system according to claim 7, wherein each of the plurality of cameras is rotatable so that the optical axis thereof is adjustable within a plane defined by the optical axis and a perpendicular bisector of the mobile device when the video recording module is connected to the mobile device.

9. The system according to claim 8, wherein the plurality of cameras are rotatable synchronously.

10. The system according to claim 1, wherein any two adjacent cameras of the plurality of cameras have their respective fields of view overlapped with each other in an overlapping portion, and the overlapping portion has an angle α

of 3°

to 5°

in the plane in which the optical axes of the two adjacent cameras are located.

11. The system according to claim 1, wherein the angle of view of each of the plurality of cameras is not less than 60°

.

12. The system according to claim 1, wherein the mobile device further includes a device memory for buffering the multi-channel video streams to be processed by the graphics processing unit and the panoramic video generated by the graphics processing unit.

13. The system according to claim 1, wherein the mobile device further includes a display screen for displaying the panoramic video at least in part.

14. The system according to claim 13, wherein the graphics processing unit is further configured to adjust the content of the panoramic video displayed on the display screen according to a user instruction.

15. The system according to claim 13, wherein the graphics processing unit is further configured to perform object tracking on the panoramic video according to a user instruction, wherein the display screen is further operable to display the tracked object.

16. The system according to claim 1, wherein the graphics processing unit is further configured to perform image stabilization computing on the panoramic video.

17. A mobile device for generating a panoramic video, including a central processing unit, a graphics processing unit and a USB interface,

wherein the USB interface is used to receive multi-channel video streams from a plurality of cameras;

wherein the central processing unit is configured to issue to the graphics processing unit an instruction to process the multi-channel video streams; and

wherein the graphics processing unit is configured to mosaic synchronous video frames of the multi-channel video streams by utilizing parallel computing according to the instruction, so as to generate the panoramic video in real time.

18. The mobile device according to claim 17, wherein the graphics processing unit is further configured to mosaic the synchronous video frames based on Compute Unified Device Architecture.

19. The mobile device according to claim 17, wherein the mobile device further includes a device memory for buffering the multi-channel video streams to be processed by the graphics processing unit and the panoramic video generated by the graphics processing unit.

20. The mobile device according to claim 17, wherein the mobile device further includes a display screen for displaying the panoramic video at least in part.