AUDIO-VIDEO DATA SWITCHING AND VIEWING SYSTEM

• US 20100146576A1
• Filed: 07/02/2009
• Published: 06/10/2010
• Est. Priority Date: 07/15/2000
• Status: Active Grant

• Current Assignee: Antonio Rossi, Filippo Costanzo, Saverio Roncolini
• Original Assignee: Antonio Rossi, Filippo Costanzo, Saverio Roncolini
• Inventors: Rossi, Antonio, Costanzo, Filippo, Roncolini, Saverio
• Granted Patent: US 8,156,236 B2
• Time in Patent Office: Days
• US Class Current: 725/117
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 67/5681 Pre-fetching or pre-delivering data based on network characteristics
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2385 Channel allocation H04N21/266 takes precedence; Bandwidth allocation H04N21/24 takes precedence ; allocation of channels according to the instantaneous demands of the users in time-division multiplex systems H04J3/1682; admission control, resource allocation in open networks H04L12/5692; arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896; negotiating bandwidth in wireless networks H04W28/16
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6547 comprising parameters, e.g. for client setup
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A computer system and method providing for viewing and switching of audio-video data. The system comprises: a plurality of audio/video sources containing information referring to an event; a streaming server, streaming the contents of a first audio signal and a first video signal from the audio and video sources to a user; a feed distributor controllably feeding the first audio signal and first video signal to the streaming server; and a user-operated control unit communicating with the feed distributor and controlling operation of the feed distributor, so as to instruct the feed distributor to switch between audio or video. Switching between audio signals occurs without altering the video signals and switching between video signals occurs without altering the audio signals.

Claims

1. A computer system for feeding audio-video data to a plurality of users, comprising:

a plurality of audio and video sources containing information referring to an event;

a streaming server, streaming the contents of a first audio file and a first video file from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file, the streaming server establishing separate sessions with the plurality of users by sending each user a separate stream; and

a feed distributor, connected between the audio and video sources and the streaming server, the feed distributor controllably feeding the first audio file and first video file to the streaming server, wherein the feed distributor can receive instructions from a user-operated control unit files, wherein upon switching, the feed distributor feeds to the streaming server a second video file which is different from the first video file without altering the first audio file, the second video file being interleaved with the first audio file.

4. The system of claim 1, wherein the system is a client-server system, the streaming server and the feed distributor being located on the server side.

5. The system of claim 4, wherein the streaming server and the feed distributor are located on the same machine.

8. The system of claim 4, wherein the streaming server sends different streams to different users, one audio file and one video file being sent to each of said different users, the feed distributor being capable of receiving instructions from each of said different users for switchably controlling said video files independently from the other users.

9. The system of claim 1, wherein the plurality of audio and video files comprises a single audio file and a plurality of video files, each video file corresponding to a different point of view of the event.

10. The system of claim 1, wherein video files are differentially compressed before streaming and comprise key frames, and wherein the control unit instructs the feed distributor switches between the first video file and the second video signal when a key frame of the second video file is encountered.

11. The system of claim 1, wherein the event is described through event parameters.

15. The system of claim 1, wherein:

the feed distributor comprises a server session manager, a theatre descriptor and a stream reader; and

the streaming server comprises a stream producer.

16. The computer system of claim 1, wherein said streaming server streams additional audio and video files, the additional audio and video files being output to secondary windows of a screen of the user, the secondary windows being different from a main window of the screen of the user where said first audio file and said first video file are output.

17. The computer system of claim 16, wherein said additional audio and video files occupy a bandwidth which is less than the bandwidth occupied by said first audio and video signal files.

20. The computer system of claim 1, where switching occurs in a preprogrammed way.

69. The method of claim 1, wherein the step of switching to the second instance occurs when a key frame in the second multimedia file is detected.

2. (canceled)

3. (canceled)

6. (canceled)

7. (canceled)

12. (canceled)

13. (canceled)

14. (canceled)

18. (canceled)

19. (canceled)

21. (canceled)

22. (canceled)

23. (canceled)

24. (canceled)

25. (canceled)

26. (canceled)

27. (canceled)

28. (canceled)

29. (canceled)

30. (canceled)

31. (canceled)

32. (canceled)

33. (canceled)

34. (canceled)

35. (canceled)

36. (canceled)

37. (canceled)

38. (canceled)

39. (canceled)

40. (canceled)

41. (canceled)

42. (canceled)

43. A computer-operated method for viewing and switching of audio-video data over a network using a client-server system, comprising the steps of:

providing a plurality of audio and video sources containing information referring to an event;

streaming on the server side contents of a first audio file and a first video file from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file;

establishing separate sessions with the plurality of users by sending each user a separate stream; and

controlling on the server side the streaming of video files, so as to switch between video files, streaming, upon switching, a second video file which is different from the first video file without altering the first audio file.

48. The method of claim 43, wherein the plurality of audio and video source signals comprises a single audio source signal and a plurality of video sources, each video signal corresponding to a different point of view of the event.

49. The method of claim 43, wherein video files are differentially compressed before streaming and comprise key frames, and wherein the controlling step switches between the first video file and the second video file when a key frame of the second video file is encountered.

44. (canceled)

45. (canceled)

46. (canceled)

47. The method of claim 46, wherein different streams are sent to different users, the system allowing each of said different users to switchably control the video files independently from the other users.

50. (canceled)

51. (canceled)

52. (canceled)

53. (canceled)

54. (canceled)

55. (canceled)

56. (canceled)

57. (canceled)

58. (canceled)

59. A computer system for viewing and switching of audio-video data, comprising:

a plurality of audio and video sources containing information referring to an event;

a streaming server for streaming the contents of a first audio file and a first video file from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file, the streaming server establishing separate sessions with the plurality of users by sending each user a separate stream; and

a feed distributor, connected between the audio and video sources and the streaming server, the feed distributor controllably feeding the first audio file and first video file to the streaming server, wherein the feed distributor can receive instructions from a user to switch between video files, wherein the video files are differentially compressed before streaming and comprise key frames, and wherein switching between the first video file and the second video signal occurs when a key frame of the second video file is encountered.

60. A computer-operated method for viewing and switching of audio-video data over a network using a client-server system, comprising the steps of:

providing a plurality of audio and video sources containing information referring to an event;

streaming on the server side contents of a first audio file and a first video file from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file;

establishing separate sessions with the plurality of users by sending each user a separate stream;

controlling on the server side the streaming of video files, so as to switch between video files, streaming, upon switching, a second video file which is different from the first video file, wherein the video files are differentially compressed before streaming and comprise key frames, and wherein the controlling step switches between the first video file and the second video file when a key frame of the second video file is encountered.

61. A computer-operated method for viewing and switching of audio-video data over a network using a client-server system, comprising the steps of:

(a) providing at least one audio file and at least two video files containing information referring to same event;

(b) streaming on the server side contents of a first audio file and a first video file to a plurality of users over a network, the first audio file being interleaved with the first video file;

(c) establishing separate sessions with the plurality of users by sending each user a separate stream;

(d) simultaneously with step (b), outputting a second video file different from the first video file; and

(e) controlling on the server side the streaming of video files, so as to switch streaming from the first video file to the second video file for at least one user.

62. The method of claim 61 wherein upon switching in step (e), the first audio file continues to be streamed.

63. The method of claim 61 wherein upon switching in step (e), a second different audio file is streamed.

64. The method of claim 61 wherein the step of switching in step (e) occurs when a key frame of the first video file is detected.

65. A computer system for viewing and switching of audio-video data, comprising:

a plurality of audio and video sources containing information referring to an event;

a streaming server for streaming the contents of a first audio file and a first video file from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file, the streaming server establishing separate sessions with the plurality of users by sending each user a separate stream; and

a feed distributor, connected between the audio and video sources and the streaming server, the feed distributor controllably feeding the first audio file and first video file to the streaming server, the feed distributor also simultaneously outputting a second video file different from the first video file without the second video file being streamed to a user, wherein the feed distributor comprises a session manager that switches between video files whereby, upon switching, the feed distributor streams the second video file to at least one selected user and stops streaming the first video file to the selected user.

66. The system of claim 65 wherein upon switching the streaming server continues to stream the first audio file to the selected user.

67. The system of claim 65 wherein the session manager instructs the feed distributor to switch when a key frame of the first video file is detected.

68. A method for persistently streaming a plurality of multimedia files over a network, the method comprising the steps of:

(a) establishing a persistent connection with a client by exposing an application-level protocol and initializing a steaming session with a server;

wherein, the streaming session encapsulates a plurality of multimedia files that are transmitted and received by the client without using bandwidth of the streaming session;

(b) creating one or more instances of a software object comprising one or more multimedia files to controllably feed a first instance in the streaming session;

wherein the one or more multimedia files is selected from the encapsulated plurality of multimedia files;

(c) exposing remote methods of the protocol for exchanging requests and parameters on the server side and the client side to transmit commands to one or more instances of the software object;

(d) receiving on the server side a client request for a second instance of the software object;

(e) transferring the second instance of the software object to the streaming session;

wherein the second instance of the software object is different than the first instance; and

(f) switching to the second instance of the software object without interrupting the persistent streaming session.

70. A system for persistently streaming a plurality of multimedia files over a network, the system comprising:

(a) an application-level protocol for establishing a persistent connection with a client and initializing a steaming session with a server;

wherein, the streaming session encapsulates a plurality of multimedia files that are transmitted and received by the client without using bandwidth of the streaming session;

(b) one or more instances of a software object comprising one or more multimedia files to controllably feed a first instance in the streaming session;

wherein the one or more multimedia files is selected from the encapsulated plurality of multimedia files;

(c) one or more server side objects communicatively coupled to the application protocol for exposing one or more remote methods of the protocol for exchanging requests and parameters with a client side object to transmit commands to one or more instances of the software object; and

(d) one or more client side objects communicatively coupled to the application protocol for exposing one or more remote methods of the protocol for exchanging requests and parameters with the server side object to transmit commands to one or more instances of the software object.

71. The system of claim 70, wherein the plurality of multimedia files comprise differential compressed video frames.

72. The system of claim 70, wherein the one or more instances of the software object has a persistent streaming session a bandwidth substantially of a single multimedia file.

73. The system of claim 70, wherein the one or more client side objects are requests from a user.

74. The system of claim 70, wherein the plurality of multimedia files comprise a single audio source and a plurality of video sources, each video source corresponding to a different point of view of an event.

75. The system of claim 70, wherein the one or more server side object comprise an infrastructure of a plurality of machines.

76. The system of claim 70, wherein the plurality of multimedia files comprises live encoded sources.

77. A method for uninterrupted visualization of multimedia content by a client from streaming data sent by a server over a network, the method comprising the steps of:

a. providing the system of claim 70;

b. exchanging event parameters between a client side and a server side according to an application-level protocol;

c. establishing a network connection with the server side using the protocol and initializing a persistent streaming session for receiving a plurality of available instances;

d. receiving from the server side a first instance of a first multimedia file, from the plurality of available instances;

e. visualizing on the client side the first instance of the multimedia file;

f. requesting from the client side a second instance from the plurality of available instances that is different from the first instance;

g. sending from the server side the second instance of the multimedia file to the client side in response to the request from the client side

h. switching from the first instance to the second instance without interrupting the streaming session; and

i. visualizing on the client side the second instance of the multimedia file.

78. The method of claim 77, wherein the step of switching occurs when a key frame in the multimedia file of the second instance is detected by the client side.