Peer-To-Peer Communications

• US 20120209933A1
• Filed: 02/16/2011
• Published: 08/16/2012
• Est. Priority Date: 02/16/2011
• Status: Active Grant

• Current Assignee: Masque Publishing, Inc.
• Original Assignee: Masque Publishing, Inc.
• Inventors: Ridges, John C., Wisler, James M.
• Granted Patent: US 9,270,784 B2
• Time in Patent Office: Days
• US Class Current: 709/208
• CPC Class Codes: H03G 3/3005 in amplifiers suitable for low-frequencies, e.g. audio amplifiers H03G3/32, H03G3/34 take precedence
• CPC Class Codes: H04L 41/0826 for reduction of network costs H04L41/0833 takes precedence
• CPC Class Codes: H04L 41/083 for increasing network speed
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 67/1051 Group master selection mechanisms
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 21/632 using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

A peer-to-peer (p2p) communication system is provided. One or both of audio and video can be transferred among a number of user terminals in the p2p system. The user terminals include at least one master terminal. The master terminal is identified, based on a determined topology, using obtained information provided in a data parameters table. Each user terminal includes a control for processing video and/or audio that is sent and/or received by the user terminal. The master terminal control can process the same video and/or audio and generate different video and/or audio data to be provided to different user terminals. Such different video data is a function of the communication paths between the master terminal and the different user terminals. Such different audio data can be a function of virtual relative positions associated with the user terminals. Audio volumes can also be separately controlled by each user terminal. Video and/or audio can be transferred in an aggregate manner, such as when the master terminal sends audio originating from a number of user terminals to another user terminal. This p2p system can be utilized with online game playing.

Claims

1. A method for communicating at least voice, comprising:

providing a plurality of user terminals including at least a master, a first slave and a second slave, at least said master, said first slave and said second slave being parts of a particular peer-to-peer system, each of said master and said first and second slaves having at least an audio input device and an audio output device;

processing audio data from said first slave using said master to generate processed first slave audio data;

processing audio data from said second slave using said master to generate processed second slave audio data;

sending at least said processed first slave audio data to said second slave using said master; and

sending at least said processed second slave audio data to said first slave using said master.

2. A method of claim 1, further including:

obtaining an audio in from said audio input device of said master;

generating first audio data of said master using said master audio in;

generating second audio data of said master using said master audio in, wherein said first audio data is different from said second audio data;

inputting an audio out based on said master first audio data to said first slave audio output device; and

inputting an audio out based on said master second audio data to said second slave audio output device.

3. A method of claim 2, further including:

aggregating at least said processed second slave audio data and said master first audio data into a first frame using a control of said master; and

aggregating at least said processed first slave audio data and said master second audio data into a second frame using said control of said master.

4. A method of claim 3, further including:

receiving said processed second slave audio data and said master first audio data by said first slave;

receiving said processed first slave audio data and said master second audio data by said second slave.

5. A method of claim 1, wherein a data parameters table is provided and is used in generating said processed first slave audio data and said processed second slave audio data, said data parameters table includes data which is obtained using measurements associated with each of said plurality of user terminals, said measurements being made using test data transfers related to at least one of bandwidth, latency and computational processing power involving said user terminals.

6. A method of claim 5, wherein said bandwidth measurements are made a plurality of times, including while a topology associated with said user terminals of said peer-to-peer system remains the same and said data of said data parameters table changes based on said bandwidth measurements.

7. A method of claim 5, wherein a plurality of fitness values are determined using said data parameters table and one or more algorithms that define a fitness function, each of said fitness values depending on a different topology associated with said user terminals, and a selected fitness value being determined using said plurality of fitness values, and in which said master, said first slave and said second slave are associated with a determined topology based on said selected fitness value.

8. A method of claim 1, wherein said master, said first slave and said second slave are associated with a determined topology that relates to connections among them in said particular peer-to-peer system and in which said determined topology is determined using data of a data parameters table, including determining which of said user terminals is said master.

9. A method of claim 8, wherein said determined topology is determined using a plurality of topologies and plurality of fitness values, and in which said determined topology is determined using also a selected fitness value obtained using said plurality of fitness values.

10. A method of claim 1, wherein said plurality of user terminals are associated with a first determined topology that relates to connections among them in said particular peer-to-peer system and said plurality of user terminals is a first plurality of user terminals, further including:

transitioning, while communications are occurring utilizing said first determined topology, from said first determined topology to a second determined topology associated with a second plurality of user terminals, wherein said second determined topology is different from said first determined topology and in which said second plurality of user terminals includes some user terminals of said first plurality of user terminals; and

completing said transitioning after each of said user terminals of said second plurality of user terminals has information related to said second determined topology.

11. A method of claim 1, wherein said processing audio data from said first slave includes decoding said first slave audio data and encoding thereafter using a control of said master.

12. A method of claim 1, further including:

obtaining audio in of said master;

generating first audio data of said master using said master audio in; and

generating second audio data of said master using said audio in, wherein said first audio data is different from said second audio data based on more compression of said master audio in to generate said first audio data than compression of said master audio in to generate said second audio data.

13. A method of claim 1, further including:

controlling volume of audio out that is output by each of said audio output devices of said first and second slaves, wherein said volume that is output by each of said audio output devices depends on a simulated position associated with each of said first and second slaves.

14. A method of claim 1, wherein said master has audio in originating from said master audio input device, and said first slave audio output device outputs audio out based on said master audio in and said second slave audio output device outputs audio out also based on said master audio in, and in which first volume associated with said first slave audio out is different from second volume associated with said second slave audio out, and each of said first and second volumes depends on simulated positions associated with each of said first and second slaves.

15. A method of claim 14, wherein each of said audio output devices of said first and second slaves includes first and second speakers, said first volume includes primary volume that is output by said first slave first speaker and secondary volume that is output by said first slave second speaker, said second volume includes primary volume that is output by said second slave second speaker and secondary volume that is output by said second slave first speaker, and in which each of said primary volumes associated with said first and second slaves is different from each of said secondary volumes associated with said first and second slaves.

16. A method of claim 1, further including:

controlling separately audio volume of each of at least said first and second slaves that is to be provided to said audio output device of said master, wherein said controlling includes controlling each of said audio volumes to be provided to said audio output device of said master so that said audio volume of said first slave is turned off and said audio volume of said second slave is not turned off.

17. A method of claim 16, wherein said audio volume of said second slave is also turned off using a volume control different than a volume control associated with said audio volume of said first slave.

18. A method of claim 16, further including:

controlling separately audio volume of each of at least said master and said second slave that is to be provided to said audio output device of said first slave, wherein said controlling includes controlling each of said audio volumes to be provided to said audio output device of said first slave so that said audio volume of said master is turned off and said audio volume of said second slave is not turned off.

19. A method of claim 16, further including:

controlling separately an audio volume of said master to be provided to said audio output device of said master including turning off said audio volume of said master.

20. A method of claim 16, wherein said master is used in controlling said audio volumes of said first and second slaves to be provided to said audio output device of said master.

21. A method of claim 20, wherein at least one of said first and second slaves is also used controlling said audio volumes of at least one of said first and second slaves to be provided to said audio output device of said master.

22. A method of claim 1, wherein processed firstly audio data of said first slave is said audio data of said first slave, processed firstly audio data of said second slave is said audio data of said second slave, processed secondly audio data of said first slave is said processed first slave audio data and processed secondly audio data of said second slave is said processed second slave audio data, and further including:

obtaining audio in from said audio input device of said master;

generating first audio data of said master using said master audio in;

generating second audio data of said master using said master audio in, wherein said first audio data is different from said second audio data;

obtaining audio in from said first slave audio input device;

obtaining audio in from said second slave audio input device;

receiving said first slave processed firstly audio data by said master;

receiving said second slave processed firstly audio data by said master;

aggregating at least said second slave processed secondly audio data and said first master first audio data into said first frame using a control of said master;

aggregating at least said first slave processed secondly audio data and said master second audio data into said second frame using said control of said master;

receiving said second slave processed secondly audio data and said master first audio data by said first slave;

receiving said first slave processed secondly audio data and said master second audio data by said second slave;

inputting an audio out, based on at least said second slave processed secondly audio data and said master first audio data, to said first slave audio output device; and

inputting an audio out, based on at least said first slave processed secondly audio data and said master second audio data, to said second slave audio output device.

23. A method of claim 1, wherein each of said master, said first slave and said second slave further includes a video input device and a video output device and in which said master receives and processes video in of said first slave and receives and processes video in of said second slave and in which said video in of said first slave is sent to said second slave after said master processes it and said video in of said second slave is sent to first slave after said master processes it.

24. A method of claim 1, wherein each of said master, said first slave and said second slave includes a video input device and a video output device, further including:

obtaining video in from said video input device of said master;

generating first video data of said master using said master video in;

generating second video data of said master using said master video in, wherein said first video data is different from said second video data;

obtaining video in from said first slave video input device;

generating processed video data of said first slave using said first slave video in;

obtaining video in from said second slave video input device;

generating processed video data of said second slave using said second slave video in;

receiving said first slave processed video data by said master;

receiving said second slave processed video data by said master;

aggregating at least said master second video data and video data based on said first slave processed video data into at least one packet of at least a first frame using a video/audio control of said master;

aggregating at least said master first video data and video data based on said second slave processed video data into at least one packet of at least a second frame using said video/audio control of said master;

receiving said master first video data and said video data based on said second slave processed video data by said first slave;

receiving said master second video data and said video data based on said first slave processed video data by said second slave;

inputting a video out based on at least said second slave processed video data and said master first video data to said first slave video output device; and

inputting a video out based on at least said first slave processed video data and said master second video data to said second slave video output device.

25. A method of claim 24 wherein at least one of:

said video data based on said first slave processed video data is less than said first slave processed video data; and

said video data based on said second slave processed video data is less than said second slave processed video data.

26. A method of claim 24, wherein said first video data is different from said second video data based on at least one of:

(a) said first video data includes less of said master video in than does said second video data; and

(b) said second video data is compressed more using said master video in than said first video data is compressed using said master video in.

27. A method of claim 24, wherein said master includes a video/audio control comprising a Flash Player and a control module, and in which said Flash Player receives said video in of said master and said control module uses one or more control outputs to communicate with said Flash Player for use in said generating said first video data and for use in said generating said second video data.

28. A method of claim 27, wherein each of said Flash Player and said control module comprises software, and in which a programming language of said software of said Flash Player is different than said programming language of said control module.

29. A method of claim 24, wherein said master is identified from among said user terminals using a data parameters table and a topology manager that is part of one of said user terminals.

30. A method of claim 29, wherein said topology manager is designated using a peer-to-peer server that is able to communicate with each of said user terminals.

31. A method of claim 30, wherein a game server communicates with each of said user terminals.

32. A method of claim 1, wherein said master is a first master and said plurality of user terminals further includes a second master and a third slave, and in which said second master communicates directly with said first master and said third slave communicates with said first master using said second master.

33. A method involving at least one or more audio volumes in a communication system, comprising:

providing a plurality of user terminals including first, second and third user terminals, each of said user terminals having an audio input device and an audio output device;

having a virtual position associated with each of said user terminals; and

controlling volume output by each of said audio output devices, wherein a first volume, associated with a first audio in from said audio input device of said first user terminal and that is output by said audio output device of said second user terminal, relates to said virtual position of said second user terminal relative to said first user terminal.

34. A method of claim 33, wherein a second volume is also associated with said first audio in and is output by said audio output device of said third user terminal, and in which said first volume is different from said second volume, with said second volume relating to said virtual position of said third user terminal relative to said first user terminal.

35. A method of claim 33, wherein said second user terminal includes a first speaker and a second speaker and said first volume includes primary volume that is output by said first speaker and secondary volume that is output by said second speaker, and in which said primary volume is different from said secondary volume and relates to said virtual position of said second user terminal relative to said first user terminal.

36. A method of claim 33, wherein each of said user terminals includes a video input device, a video output device and a video/audio control, said first terminal video input device providing a first video in during a first predetermined time, said first terminal video/audio control is used in providing each of first video data and second video data, which is different from said first video data, based on said first video in, and in which said video/audio control is also used in said controlling said first volume.

37. A method of claim 33, wherein said first user terminal is designated as a master and with said second and third user terminals being first and second slaves, and in which said first and second slaves communicate directly with said master and said first and second slaves communicate with each other using said first master, with said communication system being peer-to-peer.

38. A method of claim 33, wherein:

obtaining said audio in from said audio input device of said first user terminal;

generating first audio data of said first user terminal using said first user terminal audio in;

generating second audio data of said first user terminal using said first user terminal audio in, wherein said first audio data is different from said second audio data;

obtaining audio in from said second user terminal audio input device;

generating processed firstly audio data of said second user terminal using said second user terminal audio in;

obtaining audio in from said third user terminal audio input device;

generating processed firstly audio data of said third user terminal using said third user terminal audio in;

receiving said second user terminal processed firstly audio data by said first user terminal;

receiving said third user terminal processed firstly audio data by said first user terminal;

generating processed secondly audio data of said second user terminal using said second user terminal processed firstly audio data;

generating processed secondly audio data of said third user terminal using said third user terminal processed firstly audio data;

aggregating at least said second user terminal processed secondly audio data and said first user terminal first audio data into at least a first frame using a video/audio control of said first user terminal;

aggregating at least said third user terminal processed secondly audio data and said first user terminal second audio data into at least a second frame using said video/audio control of said first user terminal;

receiving said second user terminal processed secondly audio data and said first user terminal first audio data by said third user terminal;

receiving said third user terminal processed secondly audio data and said first user terminal second audio data by said second user terminal;

inputting an audio out based on at least said third user terminal processed secondly audio data and said first user terminal second audio data to said second user terminal audio output device; and

inputting an audio out based on at least said second user terminal processed secondly audio data and said first user terminal first audio data to said third user terminal audio output device.

39. A method involving at least one audio volume in a communication system, comprising:

providing a plurality of user terminals including first, second and third user terminals, each of said user terminals having an audio input device and an audio output device; and

controlling separately each audio volume of at least said second and third user terminals to be provided to said audio output device of said first terminal, wherein said controlling includes controlling said audio volumes to be provided to said audio output device of said first terminal so that said audio volume of said second user terminal is turned off and said audio volume of said third user terminal is not turned off.

40. A method of claim 39, wherein said audio volume of said third user terminal is also turned off using a volume control different than a volume control associated with said audio volume of said second user terminal.

41. A method of claim 39, further including:

controlling separately each audio volume of at least said first user terminal and said third user terminal to be provided to said audio output device of said second user terminal, wherein said controlling includes controlling said audio volumes to be provided to said audio output device of said second user terminal so that said audio volume of said first user terminal is turned off and said audio volume of said third user terminal is not turned off.

42. A method of claim 39, further including:

controlling separately an audio volume of said first user terminal to be provided to said audio output device of said first user terminal including turning off said audio volume of said first user terminal.

43. A method of claim 39, wherein said first user terminal is used in controlling said audio volumes of said second and third user terminals to be provided to said audio output device of said first user terminal.

44. A method of claim 43, wherein at least one of said second and third user terminals is also used in controlling said audio volume of at least one of said second and third user terminals to be provided to said audio output device of said first user terminal.

45. A peer-to-peer system for communicating one or both of voice and video, comprising:

at least one data parameters table for storing data; and

a plurality of user terminals including at least a master, a first slave and a second slave, each of said user terminals including a control for controlling at least one of audio and video and also including one or both of;

(a) an audio input device and an audio output device; and

(b) a video input device and a video output device;

wherein each of said master, said first slave and said second slave being included in a particular peer-to-peer system, and in which said master, said first slave and said second slave are associated with a determined topology that relates to connections among them in said particular peer-to-peer system and in which said determined topology is determined using said data of said data parameters table, including determining which of said user terminals is said master.

46. A system of claim 45, wherein said determined topology is determined using a plurality of topologies and plurality of fitness values, and in which said determined topology is determined using also a selected fitness value obtained using said plurality of fitness values.

47. A system of claim 45, wherein said data is obtained using measurements associated with each of said plurality of user terminals, said measurements being made using test data transfers related to at least one of bandwidth, latency and computational processing power involving said user terminals.

48. A system of claim 47, said bandwidth measurements are made a plurality of times, including while said determined topology remains the same and said data of said data parameters table changes based on said bandwidth measurements.

49. A system of claim 45, wherein a plurality of fitness values are determined using said data parameters table and one or more algorithms that define a fitness function, each of said fitness values depending on one of a number of different topologies, including one of said fitness values depending on said determined topology, associated with said user terminals, and a selected fitness value being determined using said plurality of fitness values, and in which said master, said first slave and said second slave are associated with said determined topology based on said selected fitness value.

50. A system of claim 45, wherein said data parameters table is used in determining which of said plurality of user terminals is said master, with said data parameters table including data related to at least one of:

computational processing power associated with one or more of said user terminals, latency and bandwidth.

51. A system of claim 50, wherein said master is determined using information related to connection unreliability involving said plurality of user terminals.

52. A system of claim 51, wherein said master is determined using a comparison related to at least two different topologies, including said determined topology and one that is different than said determined topology.

53. A system of claim 45, wherein said master processes audio data from said first slave to generate processed first slave audio data for sending to said second slave and processes audio data from said second slave to generate processed second slave audio data for sending to said first slave.

54. A system of claim 53, wherein said master aggregates said processed second slave audio data and first audio data of said master, and aggregates said processed first slave audio data and second audio data of said master.

55. A system of claim 45 wherein said master is identified using a topology manager, and in which one of said user terminals includes said topology manager and said topology manager is designated using a peer-to-peer server.

56. A system of claim 55, wherein a game server communicates with each of said user terminals.

57. A system of claim 45, wherein said master outputs first audio in and said master generates, using said first audio in, first audio having a first volume and second audio having a second volume that is different from said first volume, said first audio being sent to said first slave and said second audio being sent to said second slave.

58. A system of claim 57, wherein said first volume depends on a virtual position of said first slave relative to said first master.

59. A system of claim 45, wherein said audio output device of said first slave includes a first speaker and a second speaker and said first volume includes primary volume that is output by said first speaker and secondary volume that is output by said second speaker, and in which said primary volume is different from said secondary volume and relates to said virtual position of said first slave relative to said master.

60. A system of claim 45, wherein at least an audio volume of said first slave and an audio volume of said second slave for providing to said audio output device of said master are independently controlled in which said audio volume of said first slave for providing to said audio output device of said master is turned off and said audio volume of said second slave for providing to said audio output device of said master is not turned off.

61. A system of claim 45, wherein at least a video image of said first slave and a video image of said second slave for providing to said video output device of said master are independently controlled in which said video image of said first slave for providing to said video output device of said master is not displayed and said video image of said second slave for providing to said video output device of said master is displayed.

62. A system of claim 45, wherein, said control of said master controls a first video in that is output by said video input device of said master during a first time period to generate first video data and second video data which is different from said first video data, said first video data being sent to said first slave and said second video data being sent to said second slave, wherein said video output device of said first slave outputs a display using said first video data that is different from that output by said video output device of said second slave, based on said second video data being different from said first video data.

63. A system of claim 62, wherein said master control processes video data from said first slave to generate processed first slave video data and said master control processes video data from said second slave to generate processed second slave video data, and in which said master combines said master first video data and said processed second slave video data for sending to said first slave and said master combines said master second video data and said processed first slave video data for sending to said second slave.

64. A system of claim 62, wherein said master first video data is different from said master second video data based on at least one of:

(a) said master first video data includes less of said master video in than does said master second video data; and

(b) said master second video data is compressed more using said first master video in than said master first video data is compressed using said first master video in.

65. A system of claim 45, wherein said master is a first master and said plurality of user terminals further includes a second master and a third slave, said third slave communicating with said first and second slaves using said first and second masters, and said second master communicating with said first master.

66. A system of claim 45, wherein said plurality of user terminals further includes first and second hybrid terminals that communicate directly with each other and also communicate with said master.

67. A communication system involving at least audio volume control, comprising:

a plurality of user terminals including at least first, second and third user terminals, each of said user terminals having a control, an audio input device and an audio output device, wherein a first volume is controlled and with said first volume being associated with a first audio in from said audio input device of said first user terminal and that is output by said audio output device of said second user terminal, said first volume relates to at least a virtual position of said second user terminal relative to said first user terminal.

68. A system of claim 67, wherein a second volume is also associated with said first audio in and is output by said audio output device of said third user terminal, and in which said first volume is different from said second volume, with said second volume relating to a virtual position of said third user terminal relative to said first user terminal.

69. A system of claim 67, wherein said audio output device of said second user terminal includes a first speaker and a second speaker and said first volume includes a primary volume related to an output of said first speaker and a secondary volume that is related to an output of said second speaker, and in which said primary volume is different from said secondary volume and relates to said virtual position of said second user terminal relative to said first user terminal.

70. A system of claim 67, wherein said communication system further involves video and with each of said user terminals further including a video input device, a video output device, and a video/audio control, said first user terminal video input device providing a first video in during a first predetermined time, said first user terminal video/audio control is used in providing each of first video data and second video data, which is different from said first video data, based on said first video in, and in which said video/audio control is also used in controlling said first volume.

71. A system of claim 67, wherein said first user terminal is identified as a master and with said second and third user terminals being identified as first and second slaves, and in which said first and second slaves communicate directly with said master and said first and second slaves communicate with each other using said first master, with said communication system being a peer-to-peer system.

72. A communication system involving at least one audio volume, comprising:

a plurality of user terminals including first, second and third user terminals, each of said user terminals having an audio input device and an audio output device, wherein said second user terminal has an audio volume associated therewith and said third user terminal has an audio volume associated therewith, each of said audio volumes associated with said second and third user terminals for providing to said audio output device of said first user terminal, wherein said audio volume associated with said second user terminal for providing to said audio output device of said first user terminal is turned off and said audio volume associated with said third user terminal for providing to said audio output device of said first user terminal is not turned off.

73. A system of claim 72, wherein said audio volume associated with said third user terminal is also turned off using a volume control for said audio volume associated with said third user terminal that is separate from a volume control for said audio volume associated with said second user terminal.

74. A system of claim 72, wherein said first user terminal has an audio volume associated therewith, each of said audio volumes associated with said first and third user terminals for providing to said audio output device of said second user terminal, and in which said audio volume of said first user terminal is turned off and said audio volume of said third user terminal is not turned off.

75. A system of claim 72, wherein said first user terminal has an audio volume associated therewith and in which said audio volume for providing to said audio output device of said first user terminal is independently controlled, including being able to turn off said audio volume associated with said first user terminal for providing to said first user terminal.

76. A system of claim 72, wherein said first user terminal is used in controlling each of said audio volumes associated with said second and third user terminals for providing to said audio output device of said first user terminal.

77. A system of claim 76, wherein at least one of said second and third user terminals is also used in controlling said audio volume associated with at least one of said second and third user terminals for providing to said audio output device of said first user terminal.