Method and apparatus for controlling a video camera in a video conferencing system

• US 6,795,106 B1
• Filed: 05/18/1999
• Issued: 09/21/2004
• Est. Priority Date: 05/18/1999
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Cooper, Frederick J.
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US09/314,577
• Time in Patent Office: 1,953 Days
• Field of Search: H04/N.714, 348/14-1-, 348/14.1, 348/14.11, 348/14.12, 348/14.13, 382/100
• US Class Current: 348/14.08
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A video conference station is disclosed comprising an image analyzer and a camera controller. The image analyzer receives video frames from a communicatively coupled first camera, detects the head of one or more conference participants within the received video frames and detects an active participant from the one or more conference participants. The camera controller, coupled to the image analysis circuit, controls a second camera based, at least in part, on detecting the active participant.

Claims

1. A video conference station, comprising:

an image analyzer to receive video frames from a communicatively coupled first camera, to detect one or more conference participants within the received video frames and to detect an active participant within the one or more conference participants; and

a camera controller, coupled to the image analyzer, to control a second camera based, at least in part, on detecting the active participant,

wherein the image analyzer detects one or more conference participants by detecting one or more heads in the received video frames corresponding to one or more conference participants,

wherein the image analyzer detects an active participant by detecting which conference participant is currently speaking, and

wherein the image analyzer detects which participant is currently speaking by analyzing the received video frame to detect motion in a lower half of the detected head of one or more conference participants.

2. The video conference station of claim 1, further comprising one or more audio input devices to capture audio of the one or more conference participants.

3. The video conference station of claim 2, wherein the conference station further utilizes the audio captured by the one or more audio input devices to detect the active participant.

4. The video conference station of claim 3, wherein the camera controller receives input from the image analyzer and the audio input devices to pan, frame and focus the second camera on the active participant.

5. The video conference station of claim 4, wherein the camera controller sends video from the first camera to a remote conference station until an active participant is identified, and the second camera has panned, framed and focused on the active participant, whereupon the camera controller sends video from the second camera.

6. The video conference station of claim 1, further comprising a storage device having stored therein a plurality of images along with associated descriptive information for each of the plurality of images.

7. The video conference station of claim 6, whereupon detecting one or more conference participants, the image analyzer compares heads of conference participants against the plurality of images stored in the storage device to identify each of the conference participants.

8. The video conference station of claim 6, wherein the image analyzer accesses the associated descriptive information for each of the conference participants and provides such information on the detected active participant to the camera controller such that the conference station sends the descriptive information along with audio and video to one or more remote conference stations.

9. A video conference station, comprising:

an image analyzer to receive video frames from a communicatively coupled first camera, to detect one or more conference participants within the received video frames and to detect an active participant within the one or more conference participants; and

a camera controller, coupled to the image analyzer, to control a second camera based, at least in part, on detecting the active participant,

wherein the image analyzer detects an active conference participant by analyzing the received video frames to detect motion in a lower half of detected heads associated with the one or more conference participants.

10. The video conference station of claim 9, further comprising one or more audio input devices to capture audio of the one or more conference participants.

11. The video conference station of claim 10, wherein the camera controller utilizes audio information as well as video information to detect the active conference participant.

12. A video conference system comprising a plurality of video conference stations, at least one of which comprising:

an image analyzer to receive video frames from a communicatively coupled first camera, to detect one or more conference participants within the received video frames and to detect an active participant within the one or more conference participants; and

a camera controller, coupled to the image analyzer, to control a second camera based, at least in part, on detecting the active participant,

wherein the image analyzer detects an active conference participant by detecting which participant is currently speaking, and

wherein the image analyzer detects which conference participant is currently speaking by analyzing the received video frames to detect motion in a lower half of detected heads associated with the one or more conference participants.

13. The video conferencing system of claim 12, further comprising one or more audio input devices to capture audio of the one or more conference participants.

14. The video conferencing system of claim 13, wherein the camera controller utilizes audio information as well as video information to detect the active conference participant.

15. A method for featuring an active video conference participant in a video conferencing session, the method comprising:

(a) analyzing at least a subset of video frames received from a first video camera to detect an active participant from one or more detected conference participants; and

(b) controlling a second video camera to frame and focus the second video camera on the active participant based, at least in part, on the result of said analysis,

wherein detecting the active participant comprises;

receiving two or more video frames from the first video camera;

detecting one or more conference participant heads; and

monitoring a portion of the received video frames associated with a lower half of each of the one or more detected conference participant heads for movement denoting speech.

16. The method of claim 15, wherein detecting the active participant further comprises analyzing audio input from one or more audio input devices to identify which portion of the received video frames should be analyzed.

17. The method of claim 15, further comprising:

(c) selecting a video feed from the second camera, while continuing in parallel with steps (a) and (b).