Method and apparatus for capability-based multimedia interactions

• US 9,826,006 B2
• Filed: 06/06/2013
• Issued: 11/21/2017
• Est. Priority Date: 05/09/2009
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (HP Inc.)
• Inventors: Yellamraju, SivaKiran Venkata, Sanka, Tandav Krishna
• Primary Examiner(s): Vu, Kieu
• Assistant Examiner(s): Gattew, Asteway T
• Application Number:
  US13/911,233
• Publication Number:
  US 20130346881A1
• Time in Patent Office: 1,629 Days
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 69/24 Negotiation of communication capabilities

Abstract

Methods and systems are disclosed for enabling participants to interact remotely through multiple multimedia channels based on the configured capabilities of participants. The system consists of a server and one or more client devices. On joining new interactive session, the attributes and capabilities of the participant are determined. Other participants are notified as to the attributes and capabilities of the new participant. The interaction between participants is determined by their attributes and capabilities and that of the participant they wish to interact with. Participants can use a client device to join a session. If the device is capable of rendering a graphical display based on the capability information configured for that participant and device, participants can view multiple views rendered for the session in different regions of a display. The participants may interact with members of the session they select based on their mutual configured capabilities, may change the views displayed and their sizes, and may get dynamic updates as to the set of participants if their capability information supports that.

Claims

1. A computer-implemented method of displaying views of a multimedia conference executed by a client conferencing device, the method comprising:

receiving data including one or more display objects, each having a predetermined role, and a list of current participants;

graphically displaying at least a portion of the received data, wherein the graphically displaying further comprises;

constructing a view on a display of the client device, the view comprising a plurality of tiles, each tile corresponding to one or more of the one or more display objects, wherein the manner in which the tiles are sized and arranged is determined according to one or more rules based on the predetermined roles, and wherein a plurality of display objects are arranged in arched rows, the display objects in successive rows are enlarged in size in a direction from an upper portion of the display towards a lower portion of the display, each of the display objects so arranged corresponds to a listed participant, each arched row'"'"'s width is determined as a function of an immediately preceding arched row'"'"'s width, and wherein each arched row'"'"'s width is used to determine an angle associated with the arched row; and

dynamically updating the constructed view, the updating depending on a particular interaction taking place during the multimedia conference, such that the view may be dynamically changed to suit each participant without losing track of what elements and what participants are present;

wherein arranging of the display objects corresponding to listed participants is based on a time of entry into the conference by each of the listed participants.

2. The method of claim 1, wherein dynamically updating the constructed view comprises:

receiving a notification that a remote client device has joined the multimedia conference, left the multimedia conference, or changed its status attributes during a first time period; and

updating the constructed view according to the notification received from the client device, during a second time period.

3. The method of claim 2, wherein upon receiving the notification during the first time period, the client device updates the constructed view by changing at least one of size and location of display objects corresponding to the participants during the second time period.

4. The method of claim 1, wherein the view comprises three tiles, a first tile showing each connected participant, a second tile showing a host and any participant the host invites to engage in public discussion, and a third tile showing a multimedia presentation being sent from a presenter.

5. The method of claim 4, further comprising presenting controls to a user of the client device whereby the user can resize or reposition one or more of the tiles.

6. The method of claim 4, further comprising presenting controls to a user of the client device whereby the user can resize or reposition one or more display objects within one or more of the tiles.

7. The method of claim 4, wherein the presenter is the host.

8. The method of claim 4, wherein the view further comprises a fourth tile for one or more assistants to the presenter to answer logistical questions posed by the participants.

9. The method of claim 1, wherein the view comprises at least a first tile showing each connected participant, wherein a display object associated with each further participant shows state information corresponding to such participant.

10. The method of claim 9, further comprising presenting controls to a user of the client device whereby the user can resize or reposition the display object associated with each participant.

11. The method of claim 9, further comprising presenting controls to a user of the client device whereby the user can filter display objects associated with each participant so that only selected participants are viewed.

12. The method of claim 1, wherein dynamically updating the constructed view comprises applying one or more rules to an interaction in the multimedia conference to resize or reposition one or more tiles or one or more display objects within the one or more tiles.

13. The method of claim 1, wherein dynamically updating the constructed view comprises presenting controls to a user of the client device whereby the user can resize or reposition one or more tiles or one or more display objects within the one or more tiles and resizing or repositioning one or more tiles or one or more display objects within the one or more tiles according to user selections.

14. The method of claim 13, wherein presenting controls to a user whereby the user can resize or reposition one or more tiles or one or more display objects within the one or more tiles further permits the user to hide or show each tile.

15. The computer-implemented method of claim 1, wherein each of the plurality of display objects arranged in arched rows is geometrically similar to the other display objects so arranged.

16. The computer-implemented method of claim 15, wherein each of the plurality of display objects arranged in arched rows are rectangular in shape.

17. A computer-implemented method of generating and displaying an audience view of a plurality of non-presenters in a multimedia conference, the method executed by a client conferencing device, the method comprising:

receiving data including a list of current participants and a plurality of display objects, each display object comprising a video stream of a participant; and

graphically displaying at least a portion of the received data, wherein the graphically displaying further comprises;

constructing a view on a display of the client device, the display having an upper portion and a lower portion, the view comprising a plurality of arched rows, with one or more display objects in each row, wherein display objects in successive rows are reduced in size in a direction from the lower portion to the upper portion to simulate a perspective view, and each of the display objects in successive rows corresponds to a listed participant, wherein each arched row'"'"'s width is determined as a function of an immediately preceding arched row'"'"'s width, and wherein each arched row'"'"'s width is used to determine an angle associated with the arched row; and

dynamically updating the constructed view on a periodic basis as users join or leave the conference, wherein dynamically updating the constructed view on the periodic basis comprises arranging the display objects corresponding to listed participants based on a time of entry into the conference by each of the listed participants.

18. The method of claim 17, wherein the view comprises at least a first tile showing each connected participant, wherein a display object associated with each further participant shows state information corresponding to such participant.

19. The method of claim 18, further comprising presenting controls to a user of the client device whereby the user can resize or reposition the display object associated with each participant.

20. The method of claim 18, further comprising presenting controls to a user of the client device whereby the user can filter display objects associated with each participant so that only selected participants are viewed.

21. A computer-implemented method of displaying views of a multimedia conference executed by a client conferencing device, the method comprising:

receiving data including one or more display objects, each having a predetermined role, and a list of current participants; and

graphically displaying at least a portion of the received data, wherein the graphically displaying further comprises;

constructing a view on a display of the client device, the view comprising a first tile showing a plurality of connected participants, the first tile comprising a plurality of arched rows, with one or more display objects each corresponding to one of the plurality of connected participants in each row, wherein display objects in successive rows are reduced in size in a direction from a bottom portion of the display towards a higher portion of the display so as to simulate a perspective view, wherein a display object associated with each participant shows state information corresponding to such participant, wherein each arched row'"'"'s width is determined as a function of an immediately preceding arched row'"'"'s width, and wherein each arched row'"'"'s width is used to determine an angle associated with the arched row; and

dynamically updating the constructed view depending on a particular interaction taking place during the multimedia conference, such that the view may be dynamically changed to suit each participant without losing track of what elements and what participants are present,

wherein dynamically updating the constructed view comprises arranging the display objects corresponding to connected participants based on a time of entry into the conference by each of the listed participants.

22. The method of claim 21, further comprising presenting controls to a user of the client device whereby the user can filter display objects associated with each participant so that only selected participants are viewed.