Multi-purpose camera system supporting normal camera functionality and additional user input functionality

• US 9,258,483 B2
• Filed: 06/01/2012
• Issued: 02/09/2016
• Est. Priority Date: 06/01/2012
• Status: Active Grant

• Current Assignee: Taiwan Semiconductor Manufacturing Company Limited
• Original Assignee: MediaTek, Inc.
• Inventors: Ju, Chi-Cheng, Ho, Cheng-Tsai, Chen, Ding-Yun
• Primary Examiner(s): TRAN, PABLO N
• Application Number:
  US13/485,936
• Publication Number:
  US 20130324190A1
• Time in Patent Office: 1,348 Days
• Field of Search: 455/556.1, 455/66.1, 455/67.11, 455/557, 455/556.2, 455/566, 348/222.1, 348/223.1, 348/208.4, 348/E05.031, 348/E09.051, 348/208.1
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

A multi-purpose camera system includes an image capture block and an image signal processing block. The image capture block is arranged for generating an image signal, wherein the image capture block has an image sensor, an optical system, and a control circuit. The image signal processing block is arranged for processing the image signal. When the multi-purpose camera system is operated in a first operation mode, the multi-purpose camera system acts as a camera for generating a captured image output; when the multi-purpose camera system is operated in a second operation mode, the multi-purpose camera system acts as part of a user input apparatus for receiving a user input; and an overall configuration of the control circuit and the image signal processing block in the first operation mode is different from an overall configuration of the control circuit and the image signal processing block in the second operation mode.

Claims

1. A multi-purpose camera system, comprising:

an image capture block, arranged for generating an image signal, wherein the image capture block comprises an image sensor, an optical system, and a control circuit; and

an image signal processing block, arranged for processing the image signal;

wherein when the multi-purpose camera system is operated in a first operation mode, the multi-purpose camera system acts as a camera for generating a captured image output;

when the multi-purpose camera system is operated in a second operation mode, the multi-purpose camera system acts as part of a user input apparatus for receiving a user input;

an overall configuration of the control circuit and the image signal processing block in the first operation mode is different from an overall configuration of the control circuit and the image signal processing block in the second operation mode; and

at least one of the image signal processing block and the control circuit has lower power consumption in the second operation mode than in the first operation mode.

2. The multi-purpose camera system of claim 1, wherein power consumption of the image signal processing block in the second operation mode is lower than power consumption of the image signal processing block in the first operation mode.

3. The multi-purpose camera system of claim 1, wherein one signal processing module included in the image signal processing block is enabled in the first operation mode, and is disabled in the second operation mode.

4. The multi-purpose camera system of claim 1, wherein one signal processing module included in the image signal processing block employs a first algorithm in the first operation mode, and employs a second algorithm different from the first algorithm in the second operation mode.

5. The multi-purpose camera system of claim 1, wherein power consumption of the control circuit in the second operation mode is lower than power consumption of the control circuit in the first operation mode.

6. The multi-purpose camera system of claim 1, wherein one control module included in the control circuit employs a first algorithm in the first operation mode, and employs a second algorithm different from the first algorithm in the second operation mode.

7. The multi-purpose camera system of claim 1, wherein when the multi-purpose camera system acts as part of the user input apparatus, the control circuit employs a pre-defined and fixed focus parameter setting.

8. The multi-purpose camera system of claim 1, wherein when the multi-purpose camera system acts as part of the user input apparatus, the control circuit employs a pre-defined and fixed exposure parameter setting.

9. The multi-purpose camera system of claim 1, wherein the image signal processing block converts a color image into a black &

white image in the second operation mode.

10. The multi-purpose camera system of claim 9, wherein the image signal processing block performs an RGB-to-YUV color transform upon the color image, and only stores luminance values derived from the RGB-to-YUV color transform.

13. The multi-purpose camera system of claim 1, wherein a white balance module included in the image signal processing block is enabled in the first operation mode, and is disabled in the second operation mode.

14. The multi-purpose camera system of claim 1, wherein the image capture block operates at a first capture frame rate in the first operation mode, and operates at a second capture frame rate higher than the first capture frame rate in the second operation mode.

15. The multi-purpose camera system of claim 1, wherein the image capture block operates at a first capture resolution in the first operation mode, and operates at a second capture resolution lower than the first capture resolution in the second operation mode.

11. A multi-purpose camera system, comprising:

an image capture block, arranged for generating an image signal, wherein the image capture block comprises an image sensor, an optical system, and a control circuit; and

an image signal processing block, arranged for processing the image signal;

wherein when the multi-purpose camera system is operated in a first operation mode, the multi-purpose camera system acts as a camera for generating a captured image output;

when the multi-purpose camera system is operated in a second operation mode, the multi-purpose camera system acts as part of a user input apparatus for receiving a user input;

an overall configuration of the control circuit and the image signal processing block in the first operation mode is different from an overall configuration of the control circuit and the image signal processing block in the second operation mode;

the image signal processing block converts a color image into a black &

white image in the second operation mode;

the image signal processing block further compares a luminance value of a pixel in the black &

white image with a threshold value;

when the luminance value is greater than the threshold value, the image signal processing block assigns a first predetermined luminance value to the pixel; and

when the luminance value is not greater than the threshold value, the image signal processing block assigns a second predetermined luminance value to the pixel.

12. A multi-purpose camera system, comprising:

an image capture block, arranged for generating an image signal, wherein the image capture block comprises an image sensor, an optical system, and a control circuit; and

an image signal processing block, arranged for processing the image signal;

wherein when the multi-purpose camera system is operated in a first operation mode, the multi-purpose camera system acts as a camera for generating a captured image output;

when the multi-purpose camera system is operated in a second operation mode, the multi-purpose camera system acts as part of a user input apparatus for receiving a user input; and

an overall configuration of the control circuit and the image signal processing block in the first operation mode is different from an overall configuration of the control circuit and the image signal processing block in the second operation mode;

the image signal processing block converts a color image into a black &

white image in the second operation mode;

the image signal processing block further down-samples black &

white image to generate a down-sampled black &

white image, and compares a luminance value of a pixel in the down-sampled black &

white image with a threshold value;

when the luminance value is greater than the threshold value, the image signal processing block assigns a first predetermined luminance value to the pixel; and

when the luminance value is not greater than the threshold value, the image signal processing block assigns a second predetermined luminance value to the pixel.

16. An electronic device, comprising:

a multi-purpose camera system, comprising;

an image capture block, arranged for generating an image signal, wherein the image capture block comprises an image sensor, an optical system, and a control circuit; and

an image signal processing block, arranged for processing the image signal, wherein when the multi-purpose camera system is operated in a first operation mode, the multi-purpose camera system acts as a camera for generating a captured image output;

when the multi-purpose camera system is operated in a second operation mode, the multi-purpose camera system acts as part of a user input apparatus for receiving a user input;

an overall configuration of the control circuit and the image signal processing block in the first operation mode is different from an overall configuration of the control circuit and the image signal processing block in the second operation mode; and

at least one of the image signal processing block and the control circuit has lower power consumption in the second operation mode than in the first operation mode; and

a user input processing system, acting as another part of the user input apparatus and arranged for identifying the user input by processing an image output of the image signal processing block in the second operation mode.

17. The electronic device of claim 16, wherein the user input processing system comprises:

a global motion estimation block, arranged for generating global motion information according to the image output of the image signal processing block; and

a processor, arranged for identifying the user input according to the global motion information.

18. The electronic device of claim 17, wherein the global motion estimation block is an electronic image stabilization (EIS) module.

19. The electronic device of claim 16, wherein the user input processing system identifies the user input as one of a plurality of predetermined mouse operations.

20. The electronic device of claim 16, wherein the user input processing system identifies the user input as one of a plurality of predetermined directional key operations.

21. The electronic device of claim 16, wherein the user input processing system identifies the user input as one of a plurality of predetermined touch panel operations.

22. The electronic device of claim 16, being a portable electronic device.

23. The electronic device of claim 22, wherein the portable electronic device is a mobile phone.

24. A multi-purpose camera system integrated in a portable electronic device, comprising:

an image capture block, arranged for generating an image signal; and

an image signal processing block, arranged for processing the image signal;

wherein when the multi-purpose camera system is operated in a first operation mode, the multi-purpose camera system acts as a camera for generating a captured image output;

when the multi-purpose camera system is operated in a second operation mode, the multi-purpose camera system acts as part of a user input apparatus for receiving a user input; and

a control circuit included in the image capture block has lower power consumption in the second operation mode than in the first operation mode.

25. The multi-purpose camera system of claim 24, wherein the portable electronic device is a mobile phone.