INSIGHT-DRIVEN AUGMENTED AUTO-COORDINATION OF MULTIPLE VIDEO STREAMS FOR CENTRALIZED PROCESSORS

• US 20150015717A1
• Filed: 07/09/2013
• Published: 01/15/2015
• Est. Priority Date: 07/09/2013
• Status: Active Grant

• Current Assignee: GlobalFoundries, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: DUAN, NING, HAMPAPUR, ARUN, LI, HONGFEI, DONG, WEI SHAN, HU, KE, LI, LI, SUN, WEI
• Granted Patent: US 9,420,237 B2
• Time in Patent Office: Days
• US Class Current: 348/159
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A method of providing video feeds from a plurality of cameras to a plurality of screens including determining a plurality of constraints on a centralized processor processing the video feeds, determining a camera semantic classification for each of the plurality of cameras, determining historical events captured by each of the plurality of cameras, and providing at least one video feed to at least one of the screens according to the plurality of constraints on the centralized processor, the camera semantic classifications and the historical events.

Claims

1. A method of providing video feeds from a plurality of cameras to a plurality of screens comprising:

determining a plurality of constraints on a centralized processor processing the video feeds;

determining a camera semantic classification for each of the plurality of cameras;

determining a plurality of historical events captured by each of the plurality of cameras; and

providing at least one video feed from the plurality of cameras to at least one of the screens according to the plurality of constraints on the centralized processor, the camera semantic classifications and the historical events.

2. The method of claim 1, further comprising determining an importance score for each of the plurality of cameras.

3. The method of claim 2, wherein the importance score is determined according to historic data of event capture.

4. The method of claim 1, further comprising parameterizing the plurality of constraints according to a preference.

5. The method of claim 4, wherein parameterizing the plurality of constraints further comprises organizing the plurality of constraints by resource unit, wherein the centralized processor comprises a plurality of resource units, and wherein each of the plurality of resource units is associated with an importance ranking

6. The method of claim 5, wherein the organizing includes an assignment one or more of the plurality of cameras to each of the resource units of the centralized processor according to importance scores assigned to the plurality of cameras and the importance rankings of the resource units, wherein each of the centralized processors is associated with a respective one of the plurality screens.

7. The method of claim 1, wherein determining the camera semantic classifications further comprises assigning a plurality of sematic tags to describe a plurality of expected scenes of the plurality of cameras.

8. The method of claim 7, further comprising generating a hierarchical tree organizing the plurality of sematic tags.

9. The method of claim 7, further comprising generating a plurality of camera groups according to the plurality of semantic tags.

10. The method of claim 9, further comprising assigning an importance score to each of the plurality of camera groups, wherein the importance scores are determined based on an average number of events detected per camera for each of the plurality of camera groups.

11. The method of claim 10, wherein the importance scores are based on a parameterization of a configuration of the plurality of screens and an event risk of each of the plurality of camera groups.

12. The method of claim 1, wherein providing that at least one video feed to the at least one of the screens comprises generating an event camera linkage, wherein the event camera linkage is a spatial relationship between an event and a camera of the plurality of cameras.

13. A computer program product for providing video feeds from a plurality of cameras to a plurality of screens, the computer program product comprising:

a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising;

computer readable program code configured to determine a plurality of constraints on a centralized processor processing the video feeds;

computer readable program code configured to determine a camera semantic classification for each of the plurality of cameras;

computer readable program code configured to determine a plurality of historical events captured by each of the plurality of cameras; and

computer readable program code configured to provide at least one video feed from the plurality of cameras to at least one of the screens according to the plurality of constraints on the centralized processor, the camera semantic classifications and the historical events.

14. The computer program product of claim 13, further comprising computer readable program code configured to determine an importance score for each of the plurality of cameras.

15. The computer program product of claim 13, further comprising computer readable program code configured to determine parameterize the plurality of constraints according to a preference.

16. The computer program product of claim 15, wherein parameterizing the plurality of constraints further comprises organizing the plurality of constraints by resource unit, wherein the centralized processor comprises a plurality of resource units, and wherein each of the plurality of resource units is associated with an importance ranking

17. The computer program product of claim 16, wherein the organizing includes an assignment one or more of the plurality of cameras to each of the resource units of the centralized processor according to importance scores assigned to the plurality of cameras and the importance rankings of the resource units, wherein each of the centralized processors is associated with a respective one of the plurality screens.

18. The computer program product of claim 13, wherein the computer readable program code configured to determine the camera semantic classifications further comprising computer readable program code configured to assign a plurality of sematic tags to describe a plurality of expected scenes of the plurality of cameras.

19. The method of claim 18, further comprising computer readable program code configured to generate a hierarchical tree organizing the plurality of sematic tags.

20. The method of claim 19, further comprising computer readable program code configured to generate a plurality of camera groups according to the plurality of semantic tags.

21. The method of claim 20, further comprising computer readable program code configured to assign an importance score to each of the plurality of camera groups, wherein the importance scores are determined based on an average number of events detected per camera for each of the plurality of camera groups.

22. The method of claim 21, wherein the importance scores are based on a parameterization of a configuration of the plurality of screens and an event risk of each of the plurality of camera groups.

23. The method of claim 13, wherein providing that at least one video feed to the at least one of the screens comprises generating an event camera linkage, wherein the event camera linkage is a spatial relationship between an event and a camera of the plurality of cameras.

24. A system providing video feeds from a plurality of cameras to a plurality of screens comprising:

a processor basic unit determination module determining a plurality of constraints on a centralized processor processing the video feeds;

a camera parameterization module determining a camera semantic classification for each of the plurality of cameras and determining a plurality of historical events captured by each of the plurality of cameras; and

an event camera linkages module providing at least one video feed to at least one of the screens according to the plurality of constraints on the centralized processor, the camera semantic classifications and the historical events.

25. The system of claim 24, wherein the centralized processor comprises a plurality of processing units, each of the processing units associated with a respective one of the plurality of screens.