Optimal routing of audio, video, and control data through heterogeneous networks

• US 8,527,655 B2
• Filed: 05/22/2008
• Issued: 09/03/2013
• Est. Priority Date: 05/22/2007
• Status: Active Grant

• Current Assignee: Ascvid IP Holdings LLC
• Original Assignee: VidSys Incorporated
• Inventors: Morris, Stephen Jeffrey, Bartolini, David Emmanuel, Perreault, Jason John, Clarkson, Richard Casey, Staubly, Victoria Diane
• Primary Examiner(s): Fan, Hua
• Application Number:
  US12/125,134
• Publication Number:
  US 20120179835A1
• Time in Patent Office: 1,930 Days
• Field of Search: 709/238
• US Class Current: 709/238
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Effecting the transmission of video data across a network of resources that includes incompatible resources is disclosed. Information indicating a source device and a destination device is received. The source device originates the video data and the destination device is to receive the video data. A plurality of paths between the source device and the destination device is identified. Each path is defined by a set of resources, the set of resources including resources needed to transmit the video data across any incompatible resources in the path. From the plurality of paths, a best path for transmission of the video data is determined based on the set of resources for that path, a distance between the source device and the destination device along that path, and a quality of the video data maintained by that path. The transmission of the video data is then effected across the determined best path.

Claims

1. A method of effecting the transmission of video data across a network of resources, the network including incompatible resources, the method comprising:

identifying a plurality of security devices in an area to be secured, the security devices for capturing and conveying audio and video data of the area to be secured;

receiving information from at least one of the identified security devices, the information indicating a source device and a destination device, the source device originating the audio and video data and the destination device to receive the audio and video data;

identifying a plurality of paths between the source device and the destination device, each path defined by a set of resources, the set of resources including resources needed to transmit the video data and audio data across any incompatible resources in the path, wherein at least one path diverges into two branches for at least one hop in the path resulting from at least one resource that is not capable of transmitting both the video data and the audio data, the incompatibility requiring a transformation for transmission across the incompatible resource;

determining, based on available video transformation and A/D (analog to digital) conversion resources for the plurality of paths, a path for transmission of the video data, based on the set of resources for that path, a distance between the source device and the destination device along that path, and a quality of the video data maintained by that path; and

effecting the transmission of the video data across the determined path.

2. The method of claim 1 wherein the source device originates the video data and corresponding audio data, and the destination device receives the video data and the audio data;

the set of resources including resources needed to transmit the video data and the audio data across any incompatible resources in the path;

and wherein determining further comprises;

determining, a quality of the video data and the audio data maintained by that path;

and wherein effecting comprises;

effecting the transmission of the video data and the audio data across the determined path.

3. The method of claim 1 comprising:

identifying a plurality of control paths between the destination device and the source device across the network, each control path capable of carrying control data from the destination device to the source device, each control path defined by a set of resources, the set of resources including resources needed to transmit the control data across any incompatible resources in the control path;

determining, from the plurality of control paths, a control path for transmission of the control data, based on the set of resources for that control path, a distance between the destination device and the source device along that control path, and a quality of the control data maintained by that control path; and

effecting the transmission of the control data across the determined control path.

4. The method of claim 3 wherein the video data originates at a first source device and travels through a second source device to the destination device via the determined path, wherein identifying a plurality of control paths comprises:

identifying a plurality of control paths between the destination device and the first and second source devices, each control path diverging at a point so as to carry control data from the destination device to the first source device and to the second source device, each control path defined by a set of resources, the set of resources including resources needed to transmit the control data across any incompatible resources in the control path.

5. The method of claim 1 wherein receiving comprises:

receiving information indicating a source device and a destination device, the source device originating the video data and corresponding audio data and to receive control data, and the destination device to receive the video data and the audio data and originating the control data;

and wherein identifying comprises;

identifying a plurality of paths between the source device and the destination device, the plurality of paths divided into a first group and a second group, the first group capable of transmitting audio data, video data, or both, wherein each path in the first group is defined by a set of resources, the set of resources including resources needed to transmit the video data and the audio data across any incompatible resources in the path, the second group capable of transmitting control data, wherein each path in the second group is defined by a set of resources, the set of resources including resources needed to transmit the control data across any incompatible resources in the path;

and wherein determining comprises;

determining, from the first group, a first path for transmission of the video data and the audio data, based on the set of resources for that path, a distance between the source device and the destination device along that path, and a quality of the video data and the audio data maintained by that path; and

determining, from the second group, a second path for transmission of the control data, based on the set of resources for that path, a distance between the destination device and the source device along that path, and a quality of the control data maintained by that path;

and wherein effecting comprises;

effecting the transmission of the video data and the audio data across the determined first path; and

effecting the transmission of the control data across the determined second path.

6. The method of claim 1 comprising:

prior to determining, obtaining status information on the set of resources for each path in the plurality of paths, the status information indicating an availability status for each resource in the set, the status information based in part on received event data pertaining to the resource.

20. The method of claim 1 wherein the network is for transporting security-related data, further comprising:

identifying a source device capable of video origination; and

identifying a destination device capable of receiving and displaying video.

21. The method of claim 20 wherein the security-related data is gathered from security resources deployed around an area to be secured, the security related data gathered in real-time from video cameras operative for direct feedback from the area to be secured.

22. The method of claim 1 wherein the incompatible resources are resources that are physically connected yet unable to directly communicate with each other.

23. The method of claim 1 wherein the incompatible resources are unable to communicate because of an analog/digital conversion.

24. The method of claim 1 wherein the incompatible resources are unable to communicate because of corresponding codecs for interpreting video data are unavailable.

25. The method of claim 1, wherein the incompatibility is resolvable by at least one of corresponding codecs or an A/D (analog to digital) conversion.

26. The method of claim 1, wherein the incompatibility is resolvable by modifying resolution of the video data.

27. The method of claim 1, wherein the incompatibility is defined by a physical connectivity existing between the source and destination nodes but an unavailability of data at the destination node results in the incompatibility.

7. A computer program product, stored on non-transitory computer readable storage medium, for effecting the transmission of video data across a network of resources, the network including incompatible resources, the computer program product comprising:

computer program code for identifying a plurality of security devices in an area to be secured, the security devices for capturing and conveying audio and video data of the area to be secured;

computer program code for receiving information from at least one of the identified security devices, the information indicating a source device and a destination device, the source device originating the video data and accompanying audio data, and the destination device to receive the audio and video data;

computer program code for identifying a plurality of paths between the source device and the destination device, each path defined by a set of resources, the set of resources including resources needed to transmit the video data and audio data across any incompatible resources in the path, wherein at least one path diverges into two branches for at least one hop in the path resulting from at least one resource that is not capable of transmitting both the video data and the audio data;

computer program code for determining, based on available video transformation and A/D (analog to digital) conversion resources for the plurality of paths, a path for transmission of the video data, based on the set of resources for that path, a distance between the source device and the destination device along that path, and a quality of the video data maintained by that path; and

computer program code for effecting the transmission of the video data across the determined path.

8. The computer program product of claim 7 wherein computer program code for receiving comprises:

computer program code for receiving information indicating a source device and a destination device, the source device originating the video data and corresponding audio data, and the destination device to receive the video data and the audio data;

and wherein computer program code for identifying comprises;

computer program code for identifying a plurality of paths between the source device and the destination device, each path defined by a set of resources, the set of resources including resources needed to transmit the video data and the audio data across any incompatible resources in the path;

and wherein computer program code for determining comprises;

computer program code for determining, from the plurality of paths, a path for transmission of the video data and the audio data, based on the set of resources for that path, a distance between the source device and the destination device along that path, and a quality of the video data and the audio data maintained by that path;

and wherein computer program code for effecting comprises;

computer program code for effecting the transmission of the video data and the audio data across the determined path.

9. The computer program product of claim 8 wherein computer program code for identifying comprises:

computer program code for identifying a plurality of paths between the source device and the destination device, each path defined by a set of resources, the set of resources including resources needed to transmit the video data and the audio data across any incompatible resources in the path, wherein at least one path diverges into two branches for at least one hop in the path resulting from at least one resource that is not capable of transmitting both the video data and the audio data.

10. The computer program product of claim 7 comprising:

computer program code for identifying a plurality of control paths between the destination device and the source device across the network, each control path capable of carrying control data from the destination device to the source device, each control path defined by a set of resources, the set of resources including resources needed to transmit the control data across any incompatible resources in the control path;

computer program code for determining, from the plurality of control paths, a control path for transmission of the control data, based on the set of resources for that control path, a distance between the destination device and the source device along that control path, and a quality of the control data maintained by that control path; and

computer program code for effecting the transmission of the control data across the determined control path.

11. The computer program product of claim 10 wherein the video data originates at a first source device and travels through a second source device to the destination device via the determined path, wherein computer program code for identifying a plurality of control paths comprises:

computer program code for identifying a plurality of control paths between the destination device and the first and second source devices, each control path diverging at a point so as to carry control data from the destination device to the first source device and to the second source device, each control path defined by a set of resources, the set of resources including resources needed to transmit the control data across any incompatible resources in the control path.

12. The computer program product of claim 7 wherein computer program code for receiving comprises:

computer program code for receiving information indicating a source device and a destination device, the source device originating the video data and corresponding audio data and to receive control data, and the destination device to receive the video data and the audio data and originating the control data;

and wherein computer program code for identifying comprises;

computer program code for identifying a plurality of paths between the source device and the destination device, the plurality of paths divided into a first group and a second group, the first group capable of transmitting audio data, video data, or both, wherein each path in the first group is defined by a set of resources, the set of resources including resources needed to transmit the video data and the audio data across any incompatible resources in the path, the second group capable of transmitting control data, wherein each path in the second group is defined by a set of resources, the set of resources including resources needed to transmit the control data across any incompatible resources in the path;

and wherein computer program code for determining comprises;

computer program code for determining, from the first group, a first path for transmission of the video data and the audio data, based on the set of resources for that path, a distance between the source device and the destination device along that path, and a quality of the video data and the audio data maintained by that path; and

computer program code for determining, from the second group, a second path for transmission of the control data, based on the set of resources for that path, a distance between the destination device and the source device along that path, and a quality of the control data maintained by that path;

and wherein computer program code for effecting comprises;

computer program code for effecting the transmission of the video data and the audio data across the determined first path; and

computer program code for effecting the transmission of the control data across the determined second path.

13. The computer program product of claim 7 comprising:

prior to determining, computer program code for obtaining status information on the set of resources for each path in the plurality of paths, the status information indicating an availability status for each resource in the set, the status information based in part on received event data pertaining to the resource.

14. A computer system comprising:

a memory;

a processor;

a network interface; and

an interconnection mechanism coupling the memory, the processor, and the network interface, allowing communication there between;

wherein the computer system is coupled to a network of resources through the network interface, the network including incompatible resources, and wherein the memory of the computer system is encoded with a dynamic route determination application, that when executed in the processor, provides a dynamic route determination process that effects the transmission of video data and accompanying audio data across the network of resources, by causing the computer system to perform operations of;

identifying a plurality of security devices in an area to be secured, the security devices for capturing and conveying audio and video data of the area to be secured;

receiving information from at least one of the identified security devices, the information indicating a source device and a destination device, the source device originating the audio and video data and the destination device to receive the audio and video data;

identifying a plurality of paths between the source device and the destination device, each path defined by a set of resources, the set of resources including resources needed to transmit the audio and video data across any incompatible resources in the path, wherein at least one path diverges into two branches for at least one hop in the path resulting from at least one resource that is not capable of transmitting both the video data and the audio data;

determining, based on available video transformation and A/D (analog to digital) conversion resources of for the plurality of paths, a path for transmission of the video data, based on the set of resources for that path, a distance between the source device and the destination device along that path, and a quality of the video data maintained by that path; and

effecting the transmission of the video data across the determined path.

15. The computer system of claim 14 wherein receiving comprises:

receiving information indicating a source device and a destination device, the source device originating the video data and corresponding audio data, and the destination device to receive the video data and the audio data;

and wherein identifying comprises;

identifying a plurality of paths between the source device and the destination device, each path defined by a set of resources, the set of resources including resources needed to transmit the video data and the audio data across any incompatible resources in the path;

and wherein determining comprises;

determining, from the plurality of paths, a path for transmission of the video data and the audio data, based on the set of resources for that path, a distance between the source device and the destination device along that path, and a quality of the video data and the audio data maintained by that path;

and wherein effecting comprises;

effecting the transmission of the video data and the audio data across the determined path.

16. The computer system of claim 14 comprising:

identifying a plurality of control paths between the destination device and the source device across the network, each control path capable of carrying control data from the destination device to the source device, each control path defined by a set of resources, the set of resources including resources needed to transmit the control data across any incompatible resources in the control path;

determining, from the plurality of control paths, a control path for transmission of the control data, based on the set of resources for that control path, a distance between the destination device and the source device along that control path, and a quality of the control data maintained by that control path; and

effecting the transmission of the control data across the determined control path.

17. The computer system of claim 16 wherein the video data originates at a first source device and travels through a second source device to the destination device via the determined path, wherein identifying a plurality of control paths comprises:

identifying a plurality of control paths between the destination device and the first and second source devices, each control path diverging at a point so as to carry control data from the destination device to the first source device and to the second source device, each control path defined by a set of resources, the set of resources including resources needed to transmit the control data across any incompatible resources in the control path.

18. The computer system of claim 14 wherein receiving comprises:

receiving information indicating a source device and a destination device, the source device originating the video data and corresponding audio data and to receive control data, and the destination device to receive the video data and the audio data and originating the control data;

and wherein identifying comprises;

identifying a plurality of paths between the source device and the destination device, the plurality of paths divided into a first group and a second group, the first group capable of transmitting audio data, video data, or both, wherein each path in the first group is defined by a set of resources, the set of resources including resources needed to transmit the video data and the audio data across any incompatible resources in the path, the second group capable of transmitting control data, wherein each path in the second group is defined by a set of resources, the set of resources including resources needed to transmit the control data across any incompatible resources in the path;

and wherein determining comprises;

determining, from the first group, a first path for transmission of the video data and the audio data, based on the set of resources for that path, a distance between the source device and the destination device along that path, and a quality of the video data and the audio data maintained by that path; and

determining, from the second group, a second path for transmission of the control data, based on the set of resources for that path, a distance between the destination device and the source device along that path, and a quality of the control data maintained by that path;

and wherein effecting comprises;

effecting the transmission of the video data and the audio data across the determined first path; and

effecting the transmission of the control data across the determined second path.

19. The computer system of claim 14 comprising:

prior to determining, obtaining status information on the set of resources for each path in the plurality of paths, the status information indicating an availability status for each resource in the set, the status information based in part on received event data pertaining to the resource.