SCALABLE HIGH-PERFORMANCE INTERACTIVE REAL-TIME MEDIA ARCHITECTURES FOR VIRTUAL DESKTOP ENVIRONMENTS

• US 20110225513A1
• Filed: 06/30/2010
• Published: 09/15/2011
• Est. Priority Date: 03/09/2010
• Status: Abandoned Application

• Current Assignee: Avistar Communications Corporation (Avistar)
• Original Assignee: Avistar Communications Corporation (Avistar)
• Inventors: Richter, Alexander, Vysotsky, Vladimir, Lauwers, Jozef Paul C., Viswanathan, Vijayalakshmi, Ludwig, Lester, Vohra, Sumeet, Zabluda, Oleg
• Application Number:
  US12/828,257
• Publication Number:
  US 20110225513A1
• Time in Patent Office: Days
• US Class Current: 715/756
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04M 7/006 Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42

Abstract

A system for providing interactive two-way real-time media in desktop virtualization environment, the desktop virtualization environment comprising at least one desktop virtualization server computer and at least one desktop virtualization client endpoint device with an associated video camera. The system incorporates: at least one instance of server software executing on the desktop virtualization server for providing at least interactive user interface functions to an associated desktop virtualization client endpoint device, the instance of software configured to access a network; at least one instance of endpoint software executing on a desktop virtualization client endpoint device, the instance of software further comprising access to the network; and a terminal-server/terminal-client network connection between the instance of server software and instance of endpoint software, the network connection implemented using the access to the network comprised by the instance of server software and the access to network comprised by the instance of endpoint software.

Claims

1. A system for providing interactive two-way real-time media in a desktop virtualization environment, the desktop virtualization environment comprising at least one desktop virtualization server computer and at least one desktop virtualization client endpoint device with an associated video camera, the system comprising:

a. at least one instance of server software executing on the desktop virtualization server for providing at least interactive user interface functions to an associated desktop virtualization client endpoint device, the instance of software configured to access a network;

b. at least one instance of endpoint software executing on the desktop virtualization client endpoint device, the instance of software further comprising access to the network and further configured to;

i. accept real-time media input from a video camera associated with the desktop virtualization client endpoint;

ii. provide an outgoing real-time compressed media stream to the network, the outgoing real-time compressed media stream responsive to at least the real-time video input from the video camera;

iii. receive an incoming real-time compressed media stream from the network; and

iv. provide at least real-time and display functions on the desktop virtualization client endpoint device; and

c. a terminal-server/terminal-client network connection between the instance of server software and instance of endpoint software, the network connection implemented using the access to the network comprised by the instance of server software and the access to the network comprised by the instance of endpoint software,

wherein the at least one instance of server software and the at least one instance of endpoint software are configured to exchange desktop virtualization information between the instance of server software and the instance of endpoint software, the desktop virtualization information pertaining to the desktop virtualization environment though the terminal-server/terminal-client network connection; and

wherein the at least one instance of endpoint software and at least one instance of endpoint software are configured so as to transmit at least one real-time compressed media stream through the terminal-server/terminal-client network connection.

2. The system of claim 1 wherein the at least one real-time compressed media stream is the incoming real-time compressed media stream from the network.

3. The system of claim 1 wherein the at least one real-time compressed media stream is the outgoing real-time compressed media stream to the network.

4. The system of claim 1 wherein the incoming real-time media stream is provided by a different instance of endpoint software executing on a different desktop virtualization client endpoint device.

5. The system of claim 1 wherein the outgoing real-time media stream is provided to a different instance of endpoint software executing on a different desktop virtualization client endpoint device.

6. The system of claim 1 wherein the real-time media input from the video camera is a compressed media stream.

7. The system of claim 1 wherein the real-time media input from the video camera is an uncompressed media stream.

8. The system of claim 5 wherein the instance of endpoint software comprises a media compression algorithm, which performs video compression used to produce the outgoing real-time compressed media stream.

9. The system of claim 8 wherein the instance of endpoint software is configured such that, should the desktop virtualization client endpoint device comprise a multicore processor, the media compression algorithm is executed on a specific core of the multicore processor.

10. The system of claim 5 wherein at least one video compression function is provided by the hardware of desktop virtualization client endpoint device, and wherein the instance of endpoint software includes an interface for use in exchanging media streams with the hardware of desktop virtualization client endpoint device.

11. The system of claim 1 wherein the instance of endpoint software comprises media compression algorithms.

12. The system of claim 1 wherein the instance of endpoint software comprises media decompression algorithms comprising at least one media decompression function.

13. The system of claim 12 wherein the at least one media decompression function is provided by the hardware of the desktop virtualization client endpoint device, and wherein the instance of endpoint software comprises an interface for use in exchanging media streams with the hardware of desktop virtualization client endpoint device.

14. The system of claim 1 wherein the media stream comprises a video stream.

15. The system of claim 1 wherein the media stream comprises an audio stream.

16. The system of claim 1 wherein the instance of server software comprises transcoding software to transcode media streams into different formats to provide for a different set of capabilities than those provided by the terminal-server or the terminal-client.

17. A method for providing interactive two-way real-time media in a desktop virtualization environment, the desktop virtualization environment comprising at least one desktop virtualization server computer and at least one desktop virtualization client endpoint device with an associated video camera, the method comprising:

a. providing, using at least one instance of server software executing on the desktop virtualization server, at least interactive user interface functions to an associated desktop virtualization client endpoint device, the instance of software configured to access a network;

b. using at least one instance of endpoint software executing on the desktop virtualization client endpoint device, the instance of software further comprising access to the network, to;

i. accept real-time media input from a video camera associated with the desktop virtualization client endpoint;

ii. provide an outgoing real-time compressed media stream to the network, the outgoing real-time compressed media stream responsive to at least the real-time video input from the video camera;

iii. receive an incoming real-time compressed media stream from the network; and

iv. provide at least real-time and display functions on the desktop virtualization client endpoint device,

c. establishing a terminal-server/terminal-client network connection between the instance of server software and instance of endpoint software, the network connection implemented using the access to the network comprised by the instance of server software and the access to the network comprised by the instance of endpoint software;

d. exchanging desktop virtualization information between the instance of server software and the instance of endpoint software, the desktop virtualization information pertaining to the desktop virtualization environment though the terminal-server/terminal-client network connection; and

e. transmitting, by the at least one instance of endpoint software and at least one instance of endpoint software, at least one real-time compressed media stream through the terminal-server/terminal-client network connection.

18. The method of claim 17, wherein the at least one real-time compressed media stream is the incoming real-time compressed media stream from the network.

19. The method of claim 17 wherein the at least one real-time compressed media stream is the outgoing real-time compressed media stream to the network.

20. The method of claim 17 wherein the incoming real-time media stream is provided by a different instance of endpoint software executing on a different desktop virtualization client endpoint device.

21. The method of claim 17, wherein the outgoing real-time media stream is provided to a different instance of endpoint software executing on a different desktop virtualization client endpoint device.

22. The method of claim 17, wherein the real-time media input from the video camera is a compressed media stream.

23. The method of claim 17 wherein the real-time media input from the video camera is an uncompressed media stream.

24. The method of claim 17 further comprising executing a media compression algorithm, which performs video compression used to produce the outgoing real-time compressed media stream.

25. The method of claim 24 wherein should the desktop virtualization client endpoint device comprise a multicore processor, the media compression algorithm is executed on a specific core of the multicore processor.

26. The method of claim 17 wherein at least one video compression function is provided by the hardware of desktop virtualization client endpoint device, and wherein the instance of endpoint software includes an interface for use in exchanging media streams with the hardware of desktop virtualization client endpoint device.

27. The method of claim 17 wherein the instance of endpoint software comprises a media compression algorithm.

28. The method of claim 17 wherein the instance of endpoint software comprises a media decompression algorithm comprising media decompression function.

29. The method of claim 28 wherein the at least one media decompression function is provided by the hardware of the desktop virtualization client endpoint device, and wherein the instance of endpoint software comprises an interface for use in exchanging media streams with the hardware of desktop virtualization client endpoint device.

30. The method of claim 17 wherein the media stream comprises a video stream.

31. The method of claim 17 wherein the media stream comprises an audio stream.

32. The method of claim 17 wherein the instance of server software comprises transcoding software to transcode media streams into different formats to provide for a different set of capabilities than those provided by the terminal-server or the terminal-client.