Individual participant identification in shared video resources

• US 7,920,158 B1
• Filed: 07/21/2006
• Issued: 04/05/2011
• Est. Priority Date: 07/21/2006
• Status: Active Grant

• Current Assignee: Avaya Incorporated
• Original Assignee: Avaya Incorporated
• Inventors: Thambiratnam, David Preshan, Wan, James K., McNamara, Paul Thomas, Beck, Alexander J. G., Lang, Andrew W.
• Primary Examiner(s): Flynn; Nathan
• Assistant Examiner(s): CHANG, STEPHANIE L
• Application Number:
  US11/490,906
• Time in Patent Office: 1,719 Days
• Field of Search: 709/204, 705/14, 707/104.1, 455/456.2, 348/36, 348/143, 348/169, 348/14.08
• US Class Current: 348/14.08
• CPC Class Codes: H04M 2203/5081 Inform conference party of participants, e.g. of change of participants
• CPC Class Codes: H04M 3/563 User guidance or feature selection
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/441 Acquiring end-user identification , e.g. using personal code sent by the remote control or by inserting a card
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An integrated communications system is provided wherein video conferencing is conducted and participants sharing a video resource may be identified. Application of the present invention is particularly suited for videoconferencing when there are a plurality of communication endpoints, and at least one of the communication endpoints includes multiple participants at the shared video resource. A video or audio processing technique takes place to identify locations of conference participants at the communication endpoints. Each participant has an assigned RFID identifier during the conference. The RFID identifiers are interrogated by an RFID reader that downloads data from the identifiers to the system. The gathered RFID data is then matched with the processed video or audio data in order to identify each of the conference participants. A user interface is provided to allow the participants to view the other remote participants along with the identifying data of the remote participants. The data may include, for example, each remote participant'"'"'s name displayed directly below the video image of that remote participant. As time progresses during the conference, participant identity is tracked and updated by repeating the video/audio processing technique and repeating the interrogation of the RFID identifiers.

Claims

1. A method of identifying individual participants using a shared video resource during a videoconference, said method comprising:

providing each participant with an RFID identifier;

interrogating the RFID identifiers by an RFID Reader;

taking at least one video image of the participants;

conducting a video signal imaging processing technique to create a video sample providing location information for each participant, the location information indicating a location of a participant within a field of view of a camera at an associated endpoint; and

matching each RFID identifier with the corresponding participants located by said processing technique thereby providing identification of the participants.

2. A method, as claimed in claim 1, wherein:

said video signal imaging processing technique comprises applying filters to said video images to produce filtered images and applying algorithms to the filtered images to generate positional data reflective of the locations of the participants.

3. A method, as claimed in claim 1, further comprising taking an audio recording of the participants'"'"' voices and conducting an auditory signal processing technique, wherein:

said auditory signal processing technique comprises providing multiple microphones for obtaining voice signals from speaking participants and applying triangulation and auditory discrimination to said voice signals to generate positional data reflective of the locations of the speaking participants.

4. A method, as claimed in claim 1, further including:

identifying a participant speaking during said videoconference by a display provided on a user interface.

5. A method, as claimed in claim 1, further including:

providing a display on a user interface of data corresponding to each participant.

6. A method, as claimed in claim 5, wherein:

said data comprises at least one of a name, title, and organization of the participant.

7. A method, as claimed in claim 1, further including:

providing a transcription of a participant speaking, said transcription appearing on a user interface display.

8. A method, as claimed in claim 1, further including:

repeating said interrogating, taking, conducting, and matching steps to provide a continuous tracking of identification of the participants at the shared video resource.

9. A method, as claimed in claim 1, wherein:

said RFID reader is a movable, directional RFID reader.

10. A method, as claimed in claim 5, wherein:

said user interface comprises a screen display on a video monitor.

11. A method, as claimed in claim 10, wherein:

said screen display is incorporated with video images of said participants taken during the conference and viewed on said video monitor.

12. A method of identifying individual participants using a shared video resource during a videoconference, said method comprising:

assigning an RFID identifier to each participant, each said RFID identifier containing information pertaining to the assigned participant;

providing RFID data records in a database corresponding to said information of said RFID identifiers;

interrogating the RFID identifiers by an RFID reader and matching said information with said RFID data records;

taking at least one video image of the participants;

conducting a video signal imaging processing technique to create a video sample providing location information for each participant at their respective endpoint;

matching said RFID data records with the corresponding participants located by said processing technique thereby providing identification of the participants; and

repeating said interrogating, taking, conducting, and matching steps to provide a continuous tracking of identification of the participants at the shared video resource.

13. A method, as claimed in claim 12, wherein:

said video signal imaging processing technique comprises applying filters to said video images to produce filtered images and applying algorithms to the filtered images to generate positional data reflective of the locations of the participants.

14. A method, as claimed in claim 12, further comprising taking an audio recording of the participants'"'"' voices and conducting an auditory signal processing technique, wherein:

said auditory signal processing technique comprises providing multiple microphones for obtaining voice signals from speaking participants and applying triangulation and auditory discrimination to said voice signals to generate positional data reflective of the locations of the speaking participants.

15. A method, as claimed in claim 12, further including:

identifying a participant speaking during said videoconference by a display provided on a user interface.

16. A method, as claimed in claim 12, further including:

providing a display on a user interface of data corresponding to each participant.

17. A method, as claimed in claim 12, wherein:

said data records comprise at least one of a name, title, and organization of the participant.

18. A method, as claimed in claim 12, further including:

providing a transcription of a participant speaking, said transcription appearing on a user interface display.

19. A method, as claimed in claim 12, wherein:

said RFID reader is a movable, directional RFID reader.

20. A method, as claimed in claim 12, wherein:

said user interface comprises a screen display on a video monitor.

21. A method, as claimed in claim 12, wherein:

said screen display is incorporated with video images of said participants taken during the conference and viewed on said video monitor.

22. A video conferencing system enabling videoconferencing to take place between two remote communication endpoints comprising:

a camera for taking video images of participants in a videoconference at a first communication endpoint;

a data processor located at the first endpoint;

an RFID identifier associated with participants of the videoconference located at the first endpoint, each said RFID identifier including data that identifies the corresponding participant at the first endpoint;

a directional RFID reader located at the first endpoint for interrogating each RFID identifier used in the videoconference at the first endpoint;

a software application running on said processor, said software application manipulating said video images and said data obtained from said RFID reader, wherein video imaging processing of said video images provides location information of the participants at the first endpoint, and said software application further including means for matching the data from each RFID identifier with the corresponding locations of the participants determined from said video imaging processing; and

a user interface for viewing the video images of participants in the videoconference located at a second different communication endpoint, the user interface including data associated with the identified participants at the second endpoint.

23. A system, as claimed in claim 22, wherein:

said video imaging processing includes a video signal imaging processing technique comprising applying filters to said video images to produce filtered images and applying algorithms to the filtered images to generate position data reflective of the locations of the participants at the first endpoint.

24. A system, as claimed in claim 22, further including:

an auditory signal processing technique to supplement determination of the locations of the participants at the first endpoint, said auditory signal processing technique comprising a plurality of microphones incorporated at the first endpoint for obtaining audio data from voices of speaking participants, and means incorporated in said software application for processing said audio data to determine locations of said participants at the first endpoint.

25. A video conferencing system comprising:

a video camera for taking video images of participants in a videoconference;

a computing device;

an RFID transponder assigned to each participant of the videoconference, each said RFID transponder including data that identifies the corresponding participant;

an RFID reader for interrogating each RFID transponder used in the videoconference;

an application running on said computing device, said application manipulating said video images and said data obtained from said RFID transponders, wherein video imaging processing of said video images provides location information of the participants at their respective endpoint, and said application further provides means for matching the data obtained from the RFID transponders with the corresponding locations of the participants; and

a user interface for viewing the data associated with the identified participants.

26. A system, as claimed in claim 25, wherein:

said video imaging processing includes a video signal image processing technique comprising applying filters to said video images to produce filtered images and applying algorithms to the filtered images to generate positional data reflective of the locations of the participants.

27. A system, as claimed in claim 25, further including:

an auditory signal processing technique to supplement determination of the locations of participants, said auditory signal processing technique comprising a plurality of microphones incorporating at the video conference for obtaining audio data from voices of speaking participants, and means incorporated in said application for processing said audio data to determine locations of said participants.

28. A system, as claimed in claim 25, wherein:

said user interface comprises a visual display including at least one of a name, title, and organization of the participants.

29. A system, as claimed in claim 25, wherein:

said user interface comprises a visual indicator of a participant speaking.

30. A system, as claimed in claim 25, wherein:

said user interface comprises a text transcription of a speaking participant, said text transcription being placed adjacent a visual representation of the speaking participant.

31. A method of identifying individual participants using a shared video resource during a videoconference, said method comprising:

providing at least one participant with an RFID identifier;

interrogating the RFID identifier by an RFID reader;

taking video images of at least the participant with the RFID identifier;

determining a location of the at least one participant by at least one of a video signal imaging processing technique and an auditory signal processing technique; and

matching the RFID identifier with the located at least one participant thereby providing identification of the at least one participant to other remote participants of the videoconference.

32. A method of identifying individual participants using a shared video resource during a videoconference, said method comprising:

assigning an RFID identifier to at least one participant, said RFID identifier containing information pertaining to the at least one participant;

providing an RFID data record in a database corresponding to said information of said RFID identifier;

interrogating the RFID identifier by an RFID reader and matching said information with said RFID data record;

taking a video image of at least the at least one participant;

determining a location of the at least one participant by a video signal imaging processing technique;

matching said RFID data record with the located at least one participant; and

repeating said interrogating, taking, determining, and matching steps to provide a continuous tracking of identification of the at least one participant at the shared video resource.

33. A video conferencing system comprising:

a camera for taking video images of participants in a videoconference;

a data processor;

an RFID identifier associated with at least one participant of the videoconference, said RFID identifier including data that identifies the at least one participant;

an RFID reader for interrogating the RFID identifier used in the videoconference;

a software application running on said processor, said software application manipulating said video images and said data obtained from said RFID reader, wherein video imaging processing of said video images determines a location of the at least one participant, and said software application further including means for matching the data from the RFID identifier with the location of the at least one participant; and

a user interface for viewing the video images of the participants in the videoconference and the data associated with the identified at least one participant.

34. A method of identifying individual participants using a shared video resource during a videoconference, said method comprising:

providing at least one participant with an identifier, said identifier comprising at least one of a visual tag, a bar code tag, and an RFID tag;

analyzing the identifier to determine data corresponding to the identifier;

taking video images of at least the participant with the identifier;

determining a location of the at least one participant by at least one of a video signal imaging processing technique and an auditory signal processing technique; and

matching the identifier data with the located at least one participant thereby providing identification of the at least one participant to other remote participants of the videoconference.

35. A method of identifying individual participants using a shared video resource during a videoconference, said method comprising:

assigning an identifier to at least one participant, said identifier containing information pertaining to the at least one participant;

providing an identifier data record in a database corresponding to said information of said identifier;

analyzing the identifier and matching said information with said identifier data record;

taking a video image of at least the at least one participant;

determining a location of the at least one participant by a video signal imaging processing technique;

matching said identifier data record with the located at least one participant; and

repeating said analyzing, taking, determining, and matching steps to provide a continuous tracking of identification of the at least one participant at the shared video resource.

36. A video conferencing system comprising:

a camera for taking video images of participants in a videoconference;

a data processor;

an identifier associated with at least one participant of the videoconference, said identifier including data that identifies the at least one participant;

means for analyzing the identifier, said means for analyzing including at least one of the camera, a bar code reading device, and an RFID reader;

a software application running on said processor, said software application manipulating said video images and said data obtained from said means for analyzing, wherein video imaging processing of said video images determines a location of the at least one participant, and said software application further including means for matching the data from the identifier with the location of the at least one participant; and

a user interface for viewing the video images of the participants in the videoconference and the data associated with the identified at least one participant.