SYSTEM AND METHOD FOR GENERATING OUTPUT MULTIMEDIA STREAM FROM A PLURALITY OF USER PARTIALLY- OR FULLY-ANIMATED MULTIMEDIA STREAMS

• US 20090100484A1
• Filed: 09/24/2008
• Published: 04/16/2009
• Est. Priority Date: 10/10/2007
• Status: Abandoned Application

• Current Assignee: Mobinex, Inc.
• Original Assignee: Mobinex, Inc.
• Inventors: Ko, Raphael, Chaiwat, Yok, Tang, Linh
• Application Number:
  US12/236,720
• Publication Number:
  US 20090100484A1
• Time in Patent Office: Days
• US Class Current: 725/109
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44213 Monitoring of end-user related data arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4781 Games
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A system for generating an output multimedia stream user multimedia streams each comprising partially- or fully-animated images that track the movement, orientation, and facial expression of respective users, a non-user multimedia stream (e.g., television broadcast), graphic elements, and video and audio effects. The system includes a multiplexer that generates a multiplexed stream from a plurality of user multimedia streams, a selector for selecting one or more user multimedia stream from the multiplexed stream, a multimedia director device for generating the output multimedia stream from the selected streams, non-user multimedia stream, and added graphics and video effects. The output multimedia stream may be sent to the user devices for generating an interactive experience, such as an online gaming experience. These systems may be organized in a hierarchical manner, whereby regional systems provide multimedia streams to a central system that generates an output stream from the regional streams.

Claims

1. A method of generating an output multimedia stream, comprising:

receiving one or more selected user multimedia streams;

receiving other multimedia streams;

receiving graphics; and

integrating the one or more selected user multimedia streams, other multimedia streams and graphics to generate an output multimedia stream.

2. The method of claim 1, further comprising

receiving a plurality of user multimedia streams;

and

selecting said one or more selected user multimedia streams from the plurality of user multimedia streams.

3. The method of claim 2, further comprising multiplexing said plurality of user multimedia streams.

4. The method of claim 1, wherein each selected user multimedia stream includes a partially- or fully-animated image that tracks the movement, orientation, and expression of a corresponding user.

5. The method of claim 1, wherein each selected user multimedia stream includes a static image, sound, or pre-recorded video.

6. The method of claim 1, wherein the other multimedia streams comprises a television stream.

7. The method of claim 1, further comprising applying one or more video effects or one or more audio effects to generate the output multimedia stream.

8. The method of claim 1, further comprising sending the output multimedia stream to one or more users pertaining respectively to the one or more selected user multimedia streams.

9. The method of claim 8, further comprising receiving one or more selected user multimedia streams that includes a partially- or fully-animated image that tracks the movement, orientation or expression of the corresponding one or more users responding to the output multimedia stream.

10. The method of claim 9, further comprising generating additional output multimedia streams that include the one or more selected user media streams that includes the partially- or fully-animated images that tracks the movement, orientation or expression of the corresponding one or more users responding to the output multimedia stream.

11. A system for generating an output multimedia stream, comprising:

a plurality of user multimedia sources adapted to generate respective user multimedia streams comprising partial- or fully-animated images that track the movement, orientation, and facial expression of respective users; and

a multimedia director device adapted to generate an output multimedia stream comprising one or more of the user multimedia streams.

12. The system of claim 11, wherein the output multimedia stream further comprises a non-user multimedia stream for simultaneous displaying with the one or more user multimedia streams.

13. The system of claim 12, wherein the non-user multimedia stream comprises a broadcast television multimedia stream.

14. The system of claim 13, wherein the output multimedia stream further comprises graphics for simultaneous displaying with the broadcast television multimedia stream and the one or more user multimedia streams.

15. The system of claim 14, wherein the output multimedia stream further comprises one or more video effects that affect the simultaneous displaying of the broadcast television multimedia stream and the one or more user multimedia streams.

16. The system of claim 11, wherein the output multimedia stream further comprises graphics for simultaneous displaying with the one or more user multimedia streams.

17. The system of claim 16, wherein the output multimedia stream further comprises one or more video effects that affect the simultaneous displaying of the graphics and the one or more user multimedia streams.

18. The system of claim 11, further comprising a multimedia stream multiplexer adapted to generate a multiplexed multimedia stream from the user multimedia streams.

19. The system of claim 18, further comprising a multimedia stream selector adapted to generate a selected multiplexed multimedia stream from a subset of the user multimedia streams in the multiplexed multimedia stream.

20. The system of claim 19, wherein the multimedia director device is adapted to generate the output multimedia stream from the selected multiplexed multimedia stream.

21. The system of claim 11, wherein the multimedia director device is adapted to send the output multimedia stream to the plurality of user multimedia sources to provide the respective users an interactive experience.

22. A hierarchical system for generating an output multimedia stream, comprising:

a plurality of first-level systems each comprising;

a plurality of user multimedia sources adapted to generate respective user multimedia streams comprising partial- or fully-animated images that track the movement, orientation, and facial expression of respective users; and

a first-level multimedia director device adapted to generate a first-level output multimedia stream comprising one or more of the user multimedia streams; and

a second-level system comprising a second-level multimedia director adapted to generate a second-level output multimedia stream from one or more of the first-level output multimedia streams.

23. The hierarchical system of claim 22, wherein one or more of the first-level system comprises a non-user multimedia source adapted to generate a non-user multimedia stream, wherein the first-level output multimedia stream includes at least a portion of the non-user multimedia stream.

24. The hierarchical system of claim 23, wherein the non-user multimedia source comprises a broadcast television source.

25. The hierarchical system of claim 22, wherein one or more of the first-level system further comprises a source adapted to generate graphics, wherein the first-level output multimedia stream includes at least some of said graphics.

26. The hierarchical system of claim 22, wherein one or more of the first-level system further comprises a source of video effects, wherein the first-level output multimedia stream includes one or more of said video effects.

27. The hierarchical system of claim 22, wherein one or more of the first-level system further comprises a multimedia stream multiplexer adapted to generate a multiplexed multimedia stream from the user multimedia streams.

28. The hierarchical system of claim 27, wherein one or more of the first-level system further comprises a multimedia stream selector adapted to generate a selected multiplexed multimedia stream from a subset of the user multimedia streams in the multiplexed multimedia stream.

29. The hierarchical system of claim 28, wherein the corresponding multimedia director device is adapted to generate the output multimedia stream from the selected multiplexed multimedia stream.

30. The system of claim 22, wherein the second-level multimedia director device is adapted to send the output multimedia stream to the plurality of user multimedia sources to provide the respective users an interactive experience.