Video processing systems and methods

• US 9,456,131 B2
• Filed: 11/29/2013
• Issued: 09/27/2016
• Est. Priority Date: 02/26/2010
• Status: Expired due to Fees

• Current Assignee: Symmetrix Video Systems LLC (Jeffrey M. Gross)
• Original Assignee: Bao Tran
• Inventors: Tran, Bao
• Primary Examiner(s): HOLDER, ANNER N
• Application Number:
  US14/093,048
• Publication Number:
  US 20140085501A1
• Time in Patent Office: 1,033 Days
• Field of Search: 375/240.26
• US Class Current: 1/1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06N 3/063 using electronic means
• CPC Class Codes: G06N 3/084 Backpropagation, e.g. using gradient descent
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 7/12 Systems in which the television signal is transmitted via one channel or a plurality of parallel channels, the bandwidth of each channel being less than the bandwidth of the television signal H04N7/24 takes precedence
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A smart camera system is disclosed. The camera can work with cloud data storage systems and compute cloud. A call center can access the cloud to provide security monitoring services.

Claims

1. A smart camera, comprising:

an imager;

a video analytic engine (VA) coupled to the imager;

an advanced video coding (AVC) engine coupled to the imager; and

a network processor coupled to the VA engine and the AVC engine,

wherein the VA engine and the AVC engine run on a graphic processing unit (GPU) having a plurality of processors to process a plurality of computing threads and wherein the imager and the GPU are enclosed in a camera housing,

wherein the GPU generates metadata with the video to form content-aware video stored in a cloud data store, and the content-aware cloud data store includes video analytics that analyzes the content of the video data and local video data stores that store portions of the video data in response to analysis by the VA engine, and wherein video data is delivered as a managed amount of video data representing a specified quality level for a field of view.

2. The smart camera of claim 1, wherein the AVC engine comprises an H.264 engine.

3. The smart camera of claim 1, wherein the AVC engine performs scalable video coding (SVC).

4. The smart camera of claim 1, wherein the VA engine comprises a cellular neural network (CNN).

5. The smart camera of claim 1, wherein (Original) The smart camera comprises a video conferencing system, a security system or a machine vision system.

6. The smart camera of claim 1, wherein a video comprises a plurality of video slices and wherein the VA engine and the AVC engine runs on a plurality of processors each processing a slice.

7. The smart camera of claim 1, comprising a call center coupled to the network processor.

8. The smart camera of claim 1, comprising an elastic compute cloud coupled to the network processor.

9. The smart camera of claim 1, comprising a cloud based data storage device coupled to the network processor.

10. The smart camera of claim 1, comprising a parallel search engine coupled to the cloud based data storage device.

11. A smart camera, comprising:

an imager to capture a video;

a video analytic (VA) engine coupled to the imager, the VA engine detecting objects in an image and generating metadata for each object and video;

an advanced video coding (AVC) engine coupled to the imager; and

a network processor coupled to the VA engine and the AVC engine, wherein the VA engine and the AVC engine comprise a graphic processing unit (GPU) having a plurality of processors to process a plurality of computing threads and wherein the imager and the GPU are enclosed in a camera housing; and

a cloud based data storage device coupled to the network processor to store the video and affiliated metadata,

wherein the GPU generates metadata with the video to form content-aware video stored in a cloud data store, and the content-aware cloud data store includes video analytics that analyzes the content of the video data and local video data stores that store portions of the video data in response to analysis by the VA engine, and wherein video data is delivered as a managed amount of video data representing a specified quality level for a field of view.

12. The smart camera of claim 11, wherein the AVC engine comprises an H.264 engine.

13. The smart camera of claim 11, wherein the AVC engine performs scalable video coding (SVC).

14. The smart camera of claim 11, wherein the VA engine comprises a cellular neural network (CNN).

15. The smart camera of claim 11, wherein the smart camera comprises a video conferencing system, a security system or a machine vision system.

16. The smart camera of claim 11, wherein a video comprises a plurality of video slices and wherein the VA engine and the AVC engine runs on a plurality of processors each processing a slice.

17. The smart camera of claim 11, comprising a call center coupled to the network processor.

18. The smart camera of claim 11, comprising an elastic compute cloud coupled to the network processor.

19. The smart camera of claim 11, wherein the cloud based data storage device comprises a parallel database.

20. The smart camera of claim 11, comprising a parallel search engine coupled to the cloud based data storage device.