Audio-video data switching and viewing system

• US 8,156,236 B2
• Filed: 07/02/2009
• Issued: 04/10/2012
• Est. Priority Date: 07/15/2000
• Status: Expired due to Term

• Current Assignee: Antonio Rossi, Filippo Costanzo, Saverio Roncolini
• Original Assignee: Antonio Rossi, Filippo Costanzo, Saverio Roncolini
• Inventors: Roncolini, Saverio, Rossi, Antonio, Costanzo, Filippo
• Primary Examiner(s): BHATIA, AJAY M
• Application Number:
  US12/497,273
• Publication Number:
  US 20100146576A1
• Time in Patent Office: 1,013 Days
• Field of Search: 709/231
• US Class Current: 709/231
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 67/5681 Pre-fetching or pre-delivering data based on network characteristics
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2385 Channel allocation H04N21/266 takes precedence; Bandwidth allocation H04N21/24 takes precedence ; allocation of channels according to the instantaneous demands of the users in time-division multiplex systems H04J3/1682; admission control, resource allocation in open networks H04L12/5692; arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896; negotiating bandwidth in wireless networks H04W28/16
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6547 comprising parameters, e.g. for client setup
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A computer system and method providing for viewing and switching of audio-video data. The system comprises: a plurality of audio/video sources containing information referring to an event; a streaming server, streaming the contents of a first audio signal and a first video signal from the audio and video sources to a user; a feed distributor controllably feeding the first audio signal and first video signal to the streaming server; and a user-operated control unit communicating with the feed distributor and controlling operation of the feed distributor, so as to instruct the feed distributor to switch between audio or video. Switching between audio signals occurs without altering the video signals and switching between video signals occurs without altering the audio signals.

Claims

1. A system for feeding audio-video data to a plurality of users, comprising:

a plurality of audio and video sources containing information referring to an event;

a streaming server, streaming contents of a first audio file and a first video file from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file, the streaming server establishing separate sessions with the plurality of users by sending each user a separate stream; and

a feed distributor machine, connected between the plurality of audio and video sources and the streaming server, the feed distributor machine controllably feeding the first audio file and first video file to the streaming server, wherein the feed distributor machine can receive instructions from a user-operated control unit, wherein upon switching, the feed distributor machine feeds to the streaming server a second video file which is different from the first video file without altering the first audio file, the second video file being interleaved with the first audio file.

2. The system of claim 1, wherein the system is a client-server system, and the streaming server and the feed distributor machine are on the server side.

3. The system of claim 2, wherein the streaming server and the feed distributor machine are the same machine.

4. The system of claim 2, wherein the streaming server sends different streams to different users, one audio file and one video file being sent to each user, the feed distributor machine being capable of receiving instructions from each of said different users for switchably controlling said video files independently from the other users.

5. The system of claim 1, wherein the plurality of audio and video files comprises a single audio file and a plurality of video files, each video file corresponding to a different point of view of the event.

6. The system of claim 1, wherein video files are differentially compressed before streaming and comprise key frames, and wherein the control unit instructs the feed distributor machine switches between the first video file and the second video signal when a key frame is encountered.

7. The system of claim 1, wherein the event is described through event parameters.

8. The system of claim 1, wherein:

the feed distributor machine comprises a server session manager, a theatre descriptor and a stream reader; and

the streaming server comprises a stream producer.

9. The system of claim 1, wherein said streaming server streams additional audio and video files, the additional audio and video files being output to secondary windows of a screen of the user, the secondary windows being different from a main window of the screen of the user where said first audio file and said first video file are output.

10. The system of claim 9, wherein said additional audio and video files occupy a bandwidth which is less than the bandwidth occupied by said first audio and video signal files.

11. The system of claim 1, where switching occurs in a preprogrammed way.

12. A method for viewing and switching of audio-video data over a network using a client-server system, comprising the steps of:

providing a plurality of audio and video sources containing information referring to an event;

streaming on a server contents of a first audio file and a first video file from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file;

establishing separate sessions with the plurality of users by sending each user a separate stream; and

controlling on the server the streaming of video files, so as to switch between video files, streaming, upon switching, a second video file which is different from the first video file without altering the first audio file.

13. The method of claim 12, wherein different streams are sent to different users, the system allowing each of said different users to switchably control the video files independently from other users.

14. The method of claim 12, wherein the plurality of audio and video source signals comprises a single audio source signal and a plurality of video sources, each video signal corresponding to a different point of view of the event.

15. The method of claim 12, wherein video files are differentially compressed before streaming and comprise key frames, and wherein the controlling step switches between the first video file and the second video file when a key frame is encountered.

16. A system for viewing and switching of audio-video data, comprising:

a plurality of audio and video sources containing information referring to an event;

a streaming server for streaming contents of a first audio file and a first and second video files from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file, the streaming server establishing separate sessions with the plurality of users by sending each user a separate stream, at least one of the video files having a key frame; and

a feed distributor, connected between the audio and video sources and the streaming server, the feed distributor controllably feeding the first audio file and first video file to the streaming server, wherein the feed distributor can receive instructions from a user to switch between video files, wherein the video files are differentially compressed before streaming and comprise key frames, and wherein switching between the first video file and the second video signal occurs when the key frame is encountered.

17. A method for viewing and switching of audio-video data over a network using a client-server system, comprising the steps of:

providing a plurality of audio and video sources containing information referring to an event;

streaming on a server contents of a first audio file and a first video file from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file;

establishing separate sessions with the plurality of users by sending each user a separate stream;

controlling on the server the streaming of the video files, so as to switch between video files, and streaming, upon switching, a second video file which is different from the first video file,

wherein the video files are differentially compressed before streaming and comprise key frames, and wherein the controlling step switches between the first video file and the second video file when a key frame of one of the video files is encountered.

18. A computer-operated method for viewing and switching of audio-video data over a network using a client-server system, comprising the steps of:

(a) providing at least a first audio file and at least first and second video files containing information referring to same event;

(b) streaming on a server contents of the first audio file and the first video file to a plurality of users over a network, the first audio file being interleaved with the first video file;

(c) establishing separate sessions with the plurality of users by sending each user a separate stream;

(d) simultaneously with step (b), outputting the second video file, the second video file being different from the first video file; and

(e) controlling on the server side the streaming of video files, so as to switch streaming from the first video file to the second video file for at least one user.

19. The method of claim 18 wherein upon switching in step (e), the first audio file continues to be streamed.

20. The method of claim 18 wherein upon switching in step (e), a second different audio file is streamed.

21. The method of claim 18 wherein the video files have a key frame, and the step of switching in step (e) occurs when a key frame of one of the video files is detected.

22. A system for viewing and switching of audio-video data, comprising:

a plurality of audio and video sources containing information referring to an event;

a streaming server for streaming contents of a first audio file and a first video file from the audio and video sources to a plurality of users over a network, the first audio file being interleaved with the first video file, the streaming server being configured for establishing separate sessions with the plurality of users by sending each user a separate stream; and

a feed distributor machine, connected between the audio and video sources and the streaming server, the feed distributor machine being configured for controllably feeding the first audio file and first video file to the streaming server, the feed distributor machine also being configured for simultaneously outputting a second video file from the audio and video sources, the second video file being different from the first video file, the outputting of the second video file occurring without the second video file being streamed to a user,

wherein the feed distributor machine comprises a session manager that is configured to switch between video files whereby, upon switching, the feed distributor machine can cause the streaming server to stream the second video file to at least one selected user and stops streaming the first video file to the selected user.

23. The system of claim 22 wherein upon switching the streaming server continues to stream the first audio file to the selected user.

24. The system of claim 22 wherein the feed distributor machine and the streaming server are the same server.

25. The system of claim 22 wherein at least one of the video files has a key frame and the session manager is configured to instruct the feed distributor machine to switch when the key frame is detected.

26. A method for persistently streaming a plurality of multimedia files over a network, the method comprising the steps of:

(a) establishing a persistent connection with a client by exposing an application-level protocol and initializing a steaming session with a server having a client side and a server side;

wherein, the streaming session encapsulates a plurality of multimedia files that are for acknowledgement by the client without using bandwidth of the streaming session;

(b) creating one or more instances of a software object comprising one or more of the encapsulated multimedia files to controllably feed a first instance in the streaming session;

(c) exposing remote methods of the application-level protocol for exchanging requests and parameters on the server side and the client side to transmit commands to one or more instances of the software object;

(d) receiving on the server side a client request for a second instance of the software object;

(e) transferring the second instance of the software object to the streaming session;

wherein the second instance of the software object is different than the first instance; and

(f) switching to the second instance of the software object without interrupting the persistent streaming session.

27. The method of claim 26, wherein the step of switching to the second instance occurs when a key frame in one of the multimedia files is detected.

28. A system for persistently streaming a plurality of multimedia files over a network, the system comprising:

(a) an application-level protocol for establishing a persistent connection with a client and initializing a streaming session with a server, the server having a server side and a client side;

wherein, the streaming session encapsulates a plurality of multimedia files that are transmitted for receipt by the client without using bandwidth of the streaming session;

(b) one or more instances of a software object comprising one or more multimedia files to controllably feed a first instance in the streaming session;

wherein the one or more multimedia files is selected from the encapsulated plurality of multimedia files;

(c) one or more server side objects communicatively coupled to the application-level protocol for exposing one or more remote methods of the protocol for exchanging requests and parameters with a client side object to transmit commands to one or more instances of the software object; and

(d) one or more client side objects communicatively coupled to the application-level protocol for exposing one or more remote methods of the protocol for exchanging requests and parameters with the server side object to transmit commands to one or more instances of the software object.

29. The system of claim 28, wherein the plurality of multimedia files comprise differential compressed video frames.

30. The system of claim 28, wherein the one or more instances of the software object has a persistent streaming session bandwidth that is substantially the same as a single multimedia file.

31. The system of claim 28, wherein the one or more client side objects are requests from a user.

32. The system of claim 28, wherein the plurality of multimedia files comprise a single audio source and a plurality of video sources, each video source corresponding to a different point of view of an event.

33. The system of claim 28, wherein the one or more server side objects comprise an infrastructure of a plurality of machines.

34. The system of claim 28, wherein the plurality of multimedia files comprises live encoded sources.

35. A method for uninterrupted visualization of multimedia content by a client from streaming data sent by a server over a network, the method comprising the steps of:

a. providing the system of claim 28;

b. exchanging event parameters between the client side and the server side according to an application-level protocol;

c. establishing a network connection with the server side using the protocol and initializing a persistent streaming session for receiving a plurality of available instances;

d. receiving from the server side a first instance of a first multimedia file, from the plurality of available instances;

for visualizing on the client side the first instance of the multimedia file;

e. receiving from the client side a second instance from the plurality of available instances that is different from the first instance;

f. sending from the server side the second instance of the multimedia file to the client side in response to the request from the client side; and

g. switching from the first instance to the second instance without interrupting the streaming session for visualizing on the client side the second instance of the multimedia file.

36. The method of claim 35, wherein the step of switching occurs when a key frame in the multimedia file of the second instance is detected by the client side.

37. A system for providing audio-video data comprising:

a) a plurality of audio and video sources containing information referring to an event;

b) a feed distributor machine, connected between the audio and video sources; and

c) an interactive client user interface operably connected to the feed distributor machine and the plurality of audio and video sources, wherein the feed distributor machine is configured to controllably feed a first audio file and a first video file to the client;

wherein the feed distributor machine is configured to receive instructions from the interactive client user interface;

wherein upon switching, the feed distributor machine is configured to feed to the interactive client user interface a second video file which is different from the first video file when a static frame of the second video file is encountered, the feed of the second video file being done without altering the first audio file, the second video file interleaved with the first audio file to provide smooth switching between the plurality of multimedia files with no audio or video interruptions.

38. The system of claim 37 wherein the plurality of audio and video sources comprise information referring to an event are recorded in a storage.

39. The system of claim 38, wherein the event comprises event parameters that describe the event.

40. The system of claim 38 further comprising a streaming server configured to stream the contents of the first audio file and the first video file to a plurality of users over a network, where the first audio file is interleaved with the first video file, the streaming server is configured to establish separate sessions with the plurality of users sending each user a separate stream.

41. The system of claim 40, wherein the plurality of audio and video files comprises a single audio file and a plurality of video files, where each video file corresponds to a different point of view of the event.

42. The system of claim 40 wherein, the feed distributor machine is configured to receive a switch command from interactive client user interface and to stream a second video file, that is different from the first video file and a second audio file that is different from the first audio file, to the interactive client user interface;

wherein the second video file is interleaved with the second audio file to provide smooth switching between the plurality of audio and video files with no audio or video interruptions.

43. The system of claim 37, wherein the feed distributor machine comprises a server session manager, a theatre descriptor and a stream reader;

wherein the streaming server comprises a stream producer.

44. The system of claim 37, wherein the streaming server can stream a first audio and video file to a main window on a display.

45. The system of claim 37, wherein the streaming server can stream one or more audio and video files, where the one or more audio and video files are output to one or more secondary windows of a screen display, where the secondary windows are different from the main window display.

46. The system of claim 45, wherein the plurality of audio and video files occupy a bandwidth which is less than the bandwidth occupied by the first audio and video files.