Adaptive electronic zoom control

• US 6,704,048 B1
• Filed: 08/27/1998
• Issued: 03/09/2004
• Est. Priority Date: 08/27/1998
• Status: Expired due to Fees

• Current Assignee: Polycom Incorporated (HP Inc.)
• Original Assignee: Polycom Incorporated (HP Inc.)
• Inventors: Baxter, Larry K., Malkin, Kenneth W.
• Primary Examiner(s): Garber, Wendy R.
• Assistant Examiner(s): Villecco, John M.
• Application Number:
  US09/140,941
• Time in Patent Office: 2,021 Days
• Field of Search: 348/169, 348/170, 348/171, 348/172, 348/14.1, 348/14.15, 348/14.16, 348/147, 348/240.1, 348/240.2, 348/240.3, 382/256, 382/299, 382/300, 345/798
• US Class Current: 348/240.2
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04N 25/443 by reading pixels from selected 2D regions of the array, e.g. for windowing or digital zooming
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

An adaptive electronic zoom system is described which includes an electronic camera having an image sensor with pixels, a controller communicating with an address generator to select in response to an external input or feedback signals from the electronic camera a subset of pixels from the pixels of the image sensor, the subset of pixels defining a zoom area. The zoom area can be located at any position within the image sensor area. The zoom ratio/pan/tilt of the zoom area is automatically adjusted so as to maintain the location of the zoom area entirely within the image sensor area. The adaptive electronic zoom system is particularly suited for set-top boxes for video conferencing applications.

Claims

1. An adaptive electronic zoom system having electronic pan and tilt capability, comprising

a camera comprising an image sensor, said image sensor defining an imager area with an imager width, an imager height and an imager center;

a controller responsive to at least an input signal, the controller generating control signals;

an address generator responsive to the control signals and adapted to select a zoom area located within the imager area, said zoom area having a zoom width, a zoom height and a zoom center, wherein the imager width and imager height divided by the respective zoom width and zoom height, respectively, define a zoom ratio and wherein the horizontal distance between said zoom center and said image center defines a pan position and the vertical distance between said zoom center and said image center defines a tilt position;

wherein the controller automatically increases the zoom ratio as a function of the respective pan and tilt position so that the zoom area is located entirely within the imager area.

2. The zoom system of claim 1, firer comprising a scaler for scaling video signal information from said zoom area to a format suitable for at least one of display, transmission and storage.

3. The zoom system of claim 1, wherein the controller automatically increases the zoom ratio if changes in at least one of the pan and tilt positions causes at least a portion of the zoom area to be located outside the imager area.

4. The zoom system of claim 1, wherein the controller automatically adjusts at least one of the pan and tilt positions if a change in the zoom ratio causes at least a portion of the zoom area to be located outside the imager area.

5. The zoom system of claim 1, wherein said camera is a part of a video conferencing system comprising a set-top box.

6. The zoom system of claim 1, wherein said image is formed by an optical system with a fixed focal length.

7. The zoom system of claim 1, wherein said input signal is generated by a user.

8. The zoom system of claim 1, wherein said camera has a camera feedback signal and said camera feedback signal is generated by the image sensor.

9. The zoom system of claim 8, wherein said camera feedback signal is caused by the movement of an object to be imaged.

10. The zoom system of claim 8, wherein said camera feedback signal is caused by a predetermined color attribute of an object to be imaged.

11. The zoom system of claim 1, wherein said input signal is an audio signal.

12. The zoom system of claim 1, wherein said input signal is an optical signal.

13. An adaptive electronic zoom system having electronic pan and tilt capability, comprising

a camera comprising an image sensor, said image sensor defining an imager area with an imager width, an imager height and an imager center;

a controller responsive to at least an input signal, the controller generating control signals;

zoom width, a zoom height and a zoom center and located within the imager area, wherein said zoom width and zoom height, respectively, relative to the respective imager width and imager height define a zoom ratio and wherein the horizontal distance between said zoom center and said image center defines a pan position and the vertical distance between said zoom center and said image center defines a tilt position;

wherein said zoom ratio is automatically adjusted by the controller so that for a predetermined pan and tilt position the zoom ratio is no less than the maximum of the absolute value of half the imager width divided by the difference between half the imager width and the pan position, and the absolute value of half the imager height divided by the difference between half the imager height and the tilt position.

14. An imaging device with integrated electronic zoom/pan/tilt functions comprising:

an image acquisition system which generates an electronic image, said electronic image having an image area with an image width, an image height and an image center;

a controller responsive to an input signal and generating control signals;

an address generator responsive to the control signals and adapted to select a zoom area located within the image area, said zoom area having a zoom width, a zoom height and a zoom center, wherein the imager width and imager height, respectively, divided by the respective zoom width and zoom height define a zoom ratio, and wherein the horizontal distance between said zoom center and said image center defines a pan position and the vertical distance between said zoom center and said image center defines a tilt position;

wherein the controller automatically adjusts, if necessary, at least one of the pan and tilt positions in response to a decrease in the zoom ratio, so that no portion of the worn area is located outside the image area; and

, the controller automatically increases the zoom ratio, if necessary in response to a change in at least one of the pan and tilt positions, so that no portion of the zoom area is located outside the image area.

15. The imaging device of claim 14, wherein the image acquisition system is a scanner.

16. The imaging device of claim 14, wherein the image acquisition system is a video receiver receiving video signals.

17. The imaging device of claim 14, wherein the input signal is generated by a user.

18. The imaging device of claim 14, further comprising a scaler for scaling video signal information from said zoom area to a format suitable for at least one of display, transmission and storage.

19. A method of controlling an adaptive electronic zoom system with electronic pall and tilt capability of an electronic image sensor comprising imager pixels, comprising the steps of:

selecting from said imager pixels a contiguous subset of pixels wherein the subset of pixels has dimensions so as to define a zoom ratio and a pan and tilt position;

adjusting said zoom ratio in response to changes in at least one of the pan and tilt positions;

wherein the zoom ratio is automatically increased, if necessary, m response to changes in at least one of the pan and tilt positions so that no portion of the image defined by a changing pan and tilt position is located outside the imager pixels.

20. The method of claim 19 wherein said increase in the zoom ratio is performed simultaneously with said change in at least one of the pan and tilt positions.

21. A method for controlling an adaptive electronic zoom system with electronic pan and tilt capability of an electronic image sensor comprising imager pixels, comprising the steps of:

selecting from said imager pixels a contiguous subset of pixels where the subset of pixels has dimensions so as to define a zoom ratio and a pan and tilt position;

automatically adjusting, if necessary, at least one of the pan and tilt positions in response to changes in the zoom ratio;

wherein the pan and tilt position changes in response to changes in the zoom ratio so that no portion of the image defined by a changing zoom ratio is located outside the imager pixels.

22. A method for controlling an adaptive electronic zoom system with electronic pan and tilt capability, comprising the steps of:

defining a zoom ratio for selecting a zoom area from an image area;

defining at least one of a pan and tilt position of the zoom area;

automatically adjusting, if necessary, one of the pan and tilt positions in response to a decrease in the zoom ratio, so that no portion of the zoom area is located outside the image area; and

,

automatically increasing, if necessary, the zoom ratio in response to a change in at least one of the pan and tilt positions so that no portion of the zoom area is located outside the image area.

23. A video camera system with electronic zoom/pan/tilt functions for a set-top box, comprising:

a video camera operatively integrated in said set-top box and adapted to acquire an electronic image of an object, said image having an image area with an image width, an image height and an image center;

a controller responsive to an input signal and generating control signals;

an address generator responsive to the control signals and adapted to select a zoom area located within the image area, said zoom area having a zoom width, a zoom height and a zoom center, wherein the imager width and imager height, respectively, divided by the respective zoom width and zoom height define a zoom ratio, and wherein the horizontal distance between said zoom center and said image center defines a pan position and the vertical distance between said zoom center and said image center defines a tilt position;

wherein the controller automatically adjusts, if necessary, at least one of the pan and tilt positions in response to a decrease in the zoom ratio, so that no portion of the zoom area is located outside the image area; and

, the controller automatically increases the zoom ratio, if necessary, in response to a change in at least one of the pan and tilt positions, so that no portion of the zoom area is located outside the image area.

24. The video camera system of claim 23, further comprising microphone means capable of determining a location of the object and providing the input signal to the controller based on said location.

25. The video camera system of claim 23, wherein the input signal is generated in response to a signal from a remote control device.

26. The video camera system of claim 23, further comprising a scaler for scaling video signal information from said zoom area to a format suitable for at least one of display, transmission and storage.