Video conference audio/video verification

• US 9,961,299 B2
• Filed: 10/13/2016
• Issued: 05/01/2018
• Est. Priority Date: 07/27/2015
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Rosenberg, Jonathan
• Primary Examiner(s): Nguyen, Joseph J
• Application Number:
  US15/292,150
• Publication Number:
  US 20170070702A1
• Time in Patent Office: 565 Days
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: H04L 1/20 using signal quality detector
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

In one embodiment, a method implemented on a video conference participant device includes: receiving video conference data for a video conference session, performing at least the following diagnostic tests: verifying receipt of a presenter image from a presenter video conference device where the presenter video conference device is in use by a participant of the video conference meeting, the participant designated as a presenter for said video conference meeting, verifying receipt of shared desktop content from the presenter video conference device, or verifying receipt of audio data from the presenter video conference device; and transmitting results of said performing to said presenter video conference device.

Claims

1. A method implemented on a video conference participant device, the method comprising:

receiving video conference data for a video conference session;

performing at least the following diagnostic tests;

verifying receipt of a presenter image from a presenter video conference device wherein said presenter video conference device is in use by a participant of said video conference meeting, said participant designated as a presenter for said video conference meeting,

verifying receipt of shared desktop content from said presenter video conference device, and

verifying receipt of audio data from said presenter video conference device, wherein said verifying receipt of audio data comprises;

detecting whether said video conference participant device is currently configured to provide audio feedback from said video conference session, wherein said audio feedback is provided by an open microphone receiving audio signals from at least one speaker associated with said video conference participant device,

upon detecting that said video conference participant device is currently configured to provide said audio feedback, attempting to detect said audio feedback, and

upon failure to detect said audio feedback, indicating in said results failure of said receipt of audio data; and

transmitting results of said performing to said presenter video conference device.

2. The method according to claim 1 and also comprising:

receiving a request to verify receipt and presentation of audio/video data provided by said presenter video conference device.

3. The method according to claim 1 and wherein said verifying receipt of a participant image comprises:

comparing observed packet loss of video data versus a defined video data packet loss threshold; and

upon determining according to said comparing that said observed packet loss of video data exceeds said defined video data packet loss threshold, indicating in said results failure of said receipt of a presenter image.

4. The method according to claim 1 and wherein said verifying receipt of a participant image comprises:

comparing a percentage of dark pixels in said presenter image to a defined dark pixel threshold percentage, wherein said dark pixels are either black or a shade of grey; and

upon determining according to said comparing that said percentage of dark pixels is greater than said defined dark pixel threshold, indicating in said results failure of said receipt of a presenter image.

5. The method according to claim 1 and wherein said verifying receipt of a participant image comprises:

attempting to detect a facial image in said presenter image; and

upon determining that said attempting is unsuccessful, indicating in said results failure of said receipt of a presenter image.

6. The method according to claim 1 and wherein said verifying receipt of shared desktop content comprises:

upon determining that a video stream for said shared desktop content was not received on video conference participant device, indicating in said results failure of said receipt of a shared desktop content.

7. The method according to claim 1 and wherein said verifying receipt of shared desktop content comprises:

attempting to detect at least one of an embedded serial number, timestamp or timeline metadata in said shared desktop content; and

upon detecting said embedded serial number, timestamp or timeline metadata, transmitting said embedded serial number, timestamp or timeline metadata to said presenter video conference device; and

upon not detecting at least one of said embedded serial number, timestamp or timeline metadata, indicating in said results failure of said receipt of a shared desktop content.

8. The method according to claim 1 and wherein said verifying receipt of shared desktop content comprises:

determining whether a window for said video conference session is displayed as a foreground window on said video conference participant device; and

upon determining that said video conference session is not displayed as said foreground window on said video conference participant device, indicating in said results failure of said receipt of a shared desktop content.

9. The method according to claim 1 and wherein said verifying receipt of audio data comprises:

upon determining that said audio data was not received on said video conference participant device, indicating in said results failure of said receipt of audio data.

10. The method according to claim 1 and wherein said verifying receipt of audio data comprises:

comparing observed packet loss of said audio data versus a defined audio data packet loss threshold; and

upon determining according to said comparing that said observed packet loss of audio data exceeds said defined audio data packet loss threshold, indicating in said results failure of said receipt of audio data.

11. The method according to claim 1 and wherein said verifying receipt of audio data further comprises:

employing digital signal processing algorithms to detect speech-like properties in said audio data; and

upon failure to detect said speech-like properties, indicating in said results failure of said receipt of audio data.

12. The method according to claim 1 wherein said detecting whether said video conference participant device is currently configured comprises:

detecting whether said microphone is muted.

13. The method according to claim 1 wherein said attempting to detect said audio data in said audio feedback further comprises at least one of:

employing echo cancellation algorithms to detect cancellation of said audio data received by said open microphone;

or

comparing a baseline ambient noise level to audio signals received by said microphone.

14. A system implemented on a video conference participant device, the system comprising:

means for receiving video conference data for a video conference session;

means for performing at least the following diagnostic tests;

verifying receipt of a presenter image from a presenter video conference device wherein said presenter video conference device is in use by a participant of said video conference meeting, said participant designated as a presenter for said video conference meeting,

verifying receipt of shared desktop content from said presenter video conference device, or

verifying receipt of audio data from said presenter video conference device, wherein said verifying receipt of audio data comprises;

detecting whether said video conference participant device is currently configured to provide audio feedback from said video conference session, wherein said audio feedback is provided by an open microphone receiving audio signals from at least one speaker associated with said video conference participant device,

upon detecting that said video conference participant device is currently configured to provide said audio feedback, attempting to detect said audio feedback, and

upon failure to detect said audio feedback, indicating in said results failure of said receipt of audio data; and

means for transmitting results of said performing to said presenter video conference device.