Dynamic resource management for distributed retrieval system for security

• US 7,502,859 B2
• Filed: 09/19/2003
• Issued: 03/10/2009
• Est. Priority Date: 09/19/2003
• Status: Expired due to Fees

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Inoue, Shuji, Ozdemir, Hasan Timucin, Lee, Kuo Chu
• Primary Examiner(s): Avellino; Joseph E
• Assistant Examiner(s): Park; Jeong S
• Application Number:
  US10/665,772
• Publication Number:
  US 20050066331A1
• Time in Patent Office: 1,999 Days
• Field of Search: 709/223, 709/224, 709/226, 702/188, 710/5, 725/10
• US Class Current: 709/226
• CPC Class Codes: G06F 2209/5021 Priority
• CPC Class Codes: G06F 2209/508 Monitor
• CPC Class Codes: G06F 9/5044 considering hardware capabilities
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions

Abstract

A resource manager allocates operation requests to security network devices according to device characteristics. The devices collect and/or manage data from an environment. The devices may include a camera, a multimedia recorder, an analyzer, and a meta-data server. One or more users submit operation requests to a controller. The controller allocates the network devices to the operation requests according to the device characteristics. The device characteristics include availability of the device, media flow data of the device, location of the device, and capabilities of the device.

Claims

1. A resource manager for a security system network comprising:

one or more devices for collecting and/or managing data from an environment;

a flow information service storing in a computer readable medium descriptions of media flows in one or more networks, including source device and network, destination device and network, media flow type, and required bandwidth;

one or more users that submit operation requests for the data; and

a controller that;

(1) receives at least one of the operation requests, (2) finds available and capable devices appropriate for an operation specified by a received operation request and forms a set of candidates therefrom, wherein each candidate contains one or more of the found devices based on (i) the received operation request, (ii) a description of a media flow specified in the operation request, and (iii) load characteristics of the one or more devices, (3) assigns a score to the one or more devices by using;

(i) information from the load characteristics of the one or more devices and networks in a networked surveillance system, (ii) descriptions of current media flows stored by said flow information service, and (iii) dynamically configurable user preferences, where the score is a weighted function of the load characteristics, the current media flows and the user preference, and (4) allocates the one or more devices for the requested operation by selecting the one or more devices from a list of the candidates ranked according to the scores

wherein said resource manager is a multi-user application level variable rate security video media stream application system resource manager that controls grouping of security devices according to the user preferences of multiple users to support security application flows from cameras to;

(1) storage devices;

(2) image processing analyzers; and

(3) displays in a distributed network in which the multiple users;

(a) monitor multiple displays;

(b) use multiple analyzers filtering the variable rate stream; and

(c) use storage devices to store the variable rate security video stream.

2. The resource manager according to claim 1 wherein the controller generates allocation requests that attempt to allocate the operation requests to the devices in response to the operation requests.

3. The resource manager according to claim 1 wherein the controller generates a graphical representation of the load characteristics.

4. The resource manager according to claim 1 wherein the load characteristics include availability of the one or more devices.

5. The resource manager according to claim 1 wherein the load characteristics include media flow data of the one or more devices.

6. The resource manager according to claim 5 wherein the media flow data includes a source identifier, a media format, a media bandwidth requirement, a multi-cast address, and a service identifier.

7. The resource manager according to claim 1 wherein the load characteristics include location of the one or more devices, availability of the devices, and current media flow of the devices.

8. The resource manager according to claim 1 wherein the one or more devices include the camera that collects multimedia data.

9. The resource manager according to claim 8 wherein the camera streams the multimedia data in one or more media formats.

10. The resource manager according to claim 8 further comprising a multimedia recorder that records the multimedia data.

11. The resource manager according to claim 10 wherein the multimedia recorder plays the multimedia data in response to the operation requests.

12. The resource manager according to claim 10 further comprising an analyzer server that collects meta-data from the multimedia data.

13. The resource manager according to claim 12 wherein the analyzer server collects the meta-data directly from the camera.

14. The resource manager according to claim 12 wherein the analyzer server collects the meta-data from the multimedia recorder.

15. The resource manager according to claim 10 further comprising a meta-data server that stores the meta-data.

16. The resource manager according to claim 15 wherein the operation requests include searching the meta-data server for meta-data.

17. The resource manager according to claim 1 wherein the operation requests include record requests, analysis requests, play requests, and search requests.

18. The resource manager according to claim 17 wherein the record requests include at least one of a source camera identifier, a media recording format, a recording purpose, and a duration of recording.

19. The resource manager according to claim 17 wherein the analysis request includes the source camera identifier and a duration of analysis.

20. The resource manager according to claim 17 wherein the analysis request includes an identity and a location of a multimedia file.

21. The resource manager according to claim 17 wherein the play request includes the identity and a location of a multimedia file.

22. The resource manager of claim 1 further comprising an Internet gateway server that connects the users to the security system network.

23. The resource manager of claim 1 wherein the controller generates a schedule for the requests based on the load characteristics.

24. The resource manager of claim 1 wherein the controller prioritizes the operation requests.

25. The resource manager of claim 1 wherein the operation requests are generated by one of the one or more users, an alarm, and a scheduled event.

26. A method for allocating resources in a security system network comprising:

collecting data from an environment at one or more network resources;

storing in a computer readable medium descriptions of media flows in one or more networks, including source device and network, destination device and network, media flow type, and required bandwidth;

submitting requests for the data from one or more users;

finding available and capable devices appropriate for an operation specified by at least one of the submitted requests and forms a set of candidates therefrom, wherein each candidate contains one or more of the found devices based on (i) the received operation request, (ii) a description of a media flow specified in the operation request, and (iii) load characteristics of the one or more devices;

assigning a score to the one or more devices by using;

(i) information from the load characteristics of the one or more devices and networks in a networked surveillance system, (ii) descriptions of current media flows stored in the computer readable medium, and (iii) dynamically configurable user preferences, where the scores are assigned the following weighted sum formula;

27. The method of claim 26 wherein allocating resources includes generating a schedule for the requests based on the load characteristics.

28. The method of claim 27 wherein generating the schedule includes prioritizing the requests based on network criteria.

29. The method of claim 26 wherein allocating the one or more network resources includes determining a set of candidate devices, assigning scores to each candidate device in the set, and communicating with the candidate devices according to the scores.

30. The method of claim 29 further comprising calculating the scores according to a current load, a location on a network, and existing media flows.

31. The method of claim 26 wherein communicating with the candidate devices includes determining availability of the candidate devices.

32. The method of claim 26 wherein determining the load characteristics includes generating a graphical representation of the load characteristics.

33. The method of claim 32 wherein the graphical representation is a topographical map of the network.

34. The method of claim 33 wherein the topographical map includes indicia of networks and the one or more network resources in the security system network.

35. The method of claim 32 further comprising determining costs of allocating the one or more network resources to the requests according to the graphical representation.

36. The method of claim 35 further comprising storing the costs in a matrix.

37. The method of claim 26 further comprising generating a set of rules according to preferences of the one or more users.

38. The method of claim 37 wherein allocating the network resources includes allocating the one or more network resources according to the set of rules.

39. A resource manager for a security system network comprising:

one or more devices for collecting and/or managing data from an environment;

a flow information service storing in a computer readable medium descriptions of media flows in one or more networks, including source device and network, destination device and network, media flow type, and required bandwidth;

one or more users that submit operation requests for the data; and

a controller that;

(1) receives at least one of the operation requests, (2) finds available and capable devices appropriate for an operation specified by a received operation request and forms a set of candidates therefrom, wherein each candidate contains one or more of the founds devices based on (i) the received operation request. (ii) a description of a media flow specified in the operation request, and (iii) load characteristics of the one or more devices, (3) assigns a score to the one or more devices by using;

(i) information from load characteristics of the one or more devices and networks in a networked surveillance system, (ii) descriptions of current media flows stored by said flow information service, and (iii) dynamically configurable user preferences, and (4) allocates the one or more devices for the requested operation by selecting the one or more devices from a list of the candidates ranked according to the scores wherein said controller assigns scores to the one or more devices according to the following weighted sum formula;

40. The resource manager of claim 39, wherein the weights are user configurable.

41. The resource manager of claim 39, wherein said resource manager is a multi-user application level variable rate security video media stream application system resource manager that controls grouping of security devices according to the user preferences of multiple users to support security application flows from cameras to:

(1) storage devices;

(2) image processing analyzers; and

(3) displays in a distributed network in which the multiple users;

(a) monitor multiple displays;

(b) use multiple analyzers filtering the variable rate stream; and

(c) use storage devices to store the variable rate security video stream.