Mechanical pan, tilt and zoom in a webcam

• US 20060075448A1
• Filed: 10/01/2004
• Published: 04/06/2006
• Est. Priority Date: 10/01/2004
• Status: Active Grant

• Current Assignee: Logitech Europe S A (Logitech International SA)
• Original Assignee: Logitech Europe S A (Logitech International SA)
• Inventors: Krishnan, Venkatesh Tumati, McAlpine, Paul, Lechnenne, Olivier, Chang, Yuh-Lin, Miauton, Patrick, Zimmermann, Remy
• Granted Patent: US 7,917,935 B2
• Time in Patent Office: Days
• US Class Current: 725/105
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

A system and method for mechanically panning, tilting, and/or zooming a webcam to track a user'"'"'s face. In one embodiment, such movement is controlled by kernel software in a host to which the webcam sends video data. In this way, a driver in the host kernel handles the face tracking, transparent to the application programs that would access the video. In an alternate embodiment, such movement is controlled by firmware in the webcam itself. The video and control signals are sent over the same standard cable, such as a USB bus. In one embodiment, the video is supplied to an instant messaging application. The use of a standard bus (e.g., USB) and the offloading of the face tracking to the webcam and driver allows easy use by the instant messaging application.

Claims

1. A system for mechanically moving an optical module in a webcam by tracking a user'"'"'s face, the system comprising:

an optical module for capturing image data;

a machine vision module coupled to the optical module, for identifying the location of the user'"'"'s face based on the captured image data;

a movement controlling module coupled to the machine vision module for for deciding whether to move the optical module; and

a mechanical module coupled to the movement controlling module, for moving the optical module based on the decision of the movement controlling module.

2. The system of claim 1, wherein the mechanical module resides within the webcam.

3. The system of claim 1, wherein the machine vision module and the movement controller module reside within the webcam.

4. The system of claim 1, wherein the machine vision module and the movement controlling module reside within a driver in a computer communicatively coupled to the webcam.

5. The system of claim 1, wherein the image data from the webcam is provided to an instant messaging application.

6. The system of claim 1, wherein the machine vision module comprises:

a face detector for detecting a user'"'"'s face based on pre-specified parameters;

a flesh tracker for tracking movement of a user'"'"'s flesh based on flesh tone; and

a motion detector coupled to the face detector and the flesh tracker for detecting motion of a user'"'"'s face.

7. The system of claim 6, wherein the machine vision module further comprises:

a flesh sampler coupled to the face detector, for extracting a sample of the user'"'"'s flesh, and for providing this sample to the flesh tracker.

8. The system of claim 1, wherein the webcam is connected to a computer over a standard bus, with video data sent to the computer, and control signals from the computer to the webcam being both sent over the bus.

9. The system of claim 1 wherein said webcam is moved based on positive localization of facial features.

10. A method for mechanically moving a webcam which captures image data, based on the movement of a user'"'"'s face, the method comprising:

processing the image data to assess the position of the user'"'"'s face;

determining whether to move the webcam; and

responsive to a decision to move the webcam, moving the webcam.

11. The method of claim 10, wherein the step of determining whether to move the webcam comprises:

comparing the position of the user'"'"'s face to a current field of view of the webcam;

in response to the difference between the position of the user'"'"'s face and any edge of the current field of view of the webcam being more than a specified threshold, deciding not to move the webcam; and

in response to the difference between the position of the user'"'"'s face and any edge of the current field of view of the webcam being less than a specified threshold, deciding to move the webcam.

12. A webcam which mechanically moves by tracking a user'"'"'s face, the webcam comprising:

an optical module for capturing video data;

a machine vision module coupled to the optical module, for identifying the location of the user'"'"'s face based on the captured video data;

a movement controlling module coupled to the machine vision module for for deciding whether to move the optical module; and

a mechanical module coupled to the movement controlling module, for moving the optical module based on the decision of the movement controlling module.

13. A system for mechanically moving an optical module in a webcam by tracking a user'"'"'s face, the system comprising:

a webcam comprising;

an optical module for capturing video data; and

a mechanical module coupled to the optical module, for moving the optical module;

a standard bus connected to the webcam; and

a computer coupled to the standard bus, the computer having a driver module comprising;

a machine vision module coupled to the optical module, for identifying the location of the user'"'"'s face based on the captured video data;

a movement controlling module coupled to the machine vision module for deciding whether to move the optical module, and providing the decision to the mechanical module.