Image pickup device, image pickup system and image pickup method

• US 20040252223A1
• Filed: 06/04/2004
• Published: 12/16/2004
• Est. Priority Date: 06/10/2003
• Status: Abandoned Application

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Akiyama, Takashi, Okamoto, Kazuo, Juri, Tatsuro, Masuno, Takashi
• Application Number:
  US10/861,725
• Publication Number:
  US 20040252223A1
• Time in Patent Office: Days
• US Class Current: 348/345
• CPC Class Codes: H04N 23/671 in combination with active ranging signals, e.g. using light or sound signals emitted toward objects
• CPC Class Codes: H04N 23/675 comprising setting of focusing regions
• CPC Class Codes: H04N 23/84 for processing colour signals

Abstract

An image pickup device includes: an image pickup unit that converts an image projected by an optical system into image data and outputs the image data; a storage unit that stores the image data output from the image pickup unit; a detection unit that detects an emission position of a light beam emitted from an external device from the image data stored in the storage unit; and a focus control unit that sets a focus detection area based on the emission position of the light beam and makes a focus adjustment mechanism adjust a focus of the optical system so as to maximize a high frequency component in the focus detection area.

Claims

1. An image pickup device, comprising:

an image pickup unit that converts an image projected by an optical system into image data and outputs the image data;

a storage unit that stores the image data output from the image pickup unit;

a detection unit that detects an emission position of a signal emitted from an external device from the image data stored in the storage unit; and

a focus control unit that sets an area as a target of focus adjustment based on the detected emission position of the signal and adjusts a focus of the optical system so as to maximize a frequency component within a preset frequency band of image data of the area as the target of the focus adjustment.

2. The image pickup device according to claim 1,

wherein the external device is configured to be capable of emitting a light beam in a preset pattern as the signal,

the image pickup unit comprises an image pickup element that converts an image projected by the optical system into image data at a preset time interval, each piece of the image data converted by the image pickup element being output sequentially per each frame to the storage unit,

the storage unit stores therein each piece of image data output from the image pickup unit in the output order, and

the detection unit makes a comparison among the respective pieces of image data stored in the storage unit so as to detect a pixel or a group of pixels that are changed in the preset pattern and regards a position of the detected pixel or group of pixels as the emission position.

3. The image pickup device according to claim 1, further comprising a trimming unit that cuts an image displayed in accordance with the image data stored in the storage unit to be in a preset size,

wherein the trimming unit conducts the cutting so that the emission position of the signal detected by the detection unit is located at the center of the cut image or becomes close to the center of the cut image.

4. The image pickup device according to claim 3,

wherein the image pickup unit comprises an image pickup element,

the image pickup device further comprises a moving mechanism that moves both of the optical system and the image pickup element in a direction perpendicular to an optical axis of the optical system, and

the focus control unit makes the moving mechanism move both of the optical system and the image pickup element so that the emission position of the signal detected by the detection unit is located at the center of the cut image or becomes close to the center of the cut image.

5. The image pickup device according to claim 1, further comprising an exposure control unit that sets an area as an object of exposure adjustment based on the emission position of the signal, and conducts the exposure adjustment with reference to brightness of the area as the target of the exposure adjustment.

6. The image pickup device according to claim 5,

wherein the optical system comprises an aperture whose f-number is variable, and the image pickup unit comprises an electronic shutter whose shutter speed is variable, and

the exposure control unit calculates an average brightness value of the area as the target of the exposure adjustment, and adjusts at least one of the f-number and the shutter speed based on the calculated average brightness value.

7. The image pickup device according to claim 5,

wherein the optical system comprises an aperture whose f-number is variable and a shutter mechanism whose shutter speed is variable, and

the exposure control unit calculates an average brightness value of the area as the target of the exposure adjustment, and adjusts at least one of the f-number and the shutter speed based on the calculated average brightness value.

8. The image pickup device according to claim 1, wherein the external device is a remote control device for conducting remote control of the image pickup device.

9. The image pickup device according to claim 8,

wherein the remote control device comprises a case provided with a portion in a preset reference color, and

the image pickup device comprises a white balance adjustment unit that conducts adjustment of white balance with reference to the reference color.

10. The image pickup device according to claim 9,

wherein the white balance adjustment unit comprises:

a reference area extraction unit that extracts image data of an area including the portion in the reference color from the image data stored in the storage unit;

a gain adjustment value calculation unit that calculates a gain adjustment value based on the extracted image data of the area including the portion in the reference color, the gain adjustment value being for making a RGB ratio of an average color of the area including the portion in the reference color a preset ratio;

a color separation unit that separates the image data stored in the storage unit into a R component, a G component and a B component; and

a gain adjustment unit that conducts gain adjustment of at least one of the R component, the G component and the B component using the calculated gain adjustment value.

11. An image pickup device, comprising:

an image pickup unit that converts an image projected by an optical system into image data and outputs the image data;

a storage unit that stores the image data output from the image pickup unit;

a detection unit that detects an emission position of a signal emitted from an external device from the image data stored in the storage unit; and

an exposure control unit that sets an area as a target of exposure adjustment based on the detected emission position of the signal and conducts the exposure adjustment with reference to brightness of the area as the target of the exposure adjustment.

12. The image pickup device according to claim 11,

wherein the external device is configured to be capable of emitting a light beam in a preset pattern as the signal,

the image pickup unit comprises an image pickup element that converts an image projected by the optical system into image data at a preset time interval, each piece of the image data converted by the image pickup element being output sequentially per each frame to the storage unit,

the storage unit stores therein each piece of image data output from the image pickup unit in the output order, and

the detection unit makes a comparison among the respective pieces of image data stored in the storage unit so as to detect a pixel or a group of pixels that are changed in the preset pattern and regards the detected pixel or group of pixels as the emission position.

13. The image pickup device according to claim 11,

wherein the optical system comprises an aperture whose f-number is variable, and the image pickup unit comprises an electronic shutter whose shutter speed is variable, and

the exposure control unit calculates an average brightness value of the area as the target of the exposure adjustment, and adjusts at least one of the f-number and the shutter speed based on the calculated average brightness value.

14. The image pickup device according to claim 11,

wherein the optical system comprises an aperture whose f-number is variable and a shutter mechanism whose shutter speed is variable, and

the exposure control unit calculates an average brightness value of the area as the target of the exposure adjustment, and adjusts at least one of the f-number and the shutter speed based on the calculated average brightness value.

15. The image pickup device according to claim 11, further comprising a trimming unit that cuts an image displayed in accordance with the image data stored in the storage unit to be in a preset size,

wherein the trimming unit conducts the cutting so that the emission position of the signal detected by the detection unit is located at the center of the cut image or becomes close to the center of the cut image.

16. The image pickup device according to claim 15,

wherein the image pickup unit comprises an image pickup element,

the image pickup device further comprises a moving mechanism that moves both of the optical system and the image pickup element in a direction perpendicular to an optical axis of the optical system, and

the focus control unit makes the moving mechanism move both of the optical system and the image pickup element so that the emission position of the signal detected by the detection unit is located at the center of the cut image or becomes close to the center of the cut image.

17. The image pickup device according to claim 11, wherein the external device is a remote control device for conducting remote control of the image pickup device.

18. The image pickup device according to claim 17,

wherein the remote control device comprises a case provided with a portion in a preset reference color, and

the image pickup device comprises a white balance adjustment unit that conducts adjustment of white balance with reference to the reference color.

19. The image pickup device according to claim 18,

wherein the white balance adjustment unit comprises:

a reference area extraction unit that extracts image data of an area including the portion in the reference color from the image data stored in the storage unit;

a gain adjustment value calculation unit that calculates a gain adjustment value based on the extracted image data of the area including the portion in the reference color, the gain adjustment value being for making a RGB ratio of an average color of the area including the portion in the reference color a preset ratio;

a color separation unit that separates the image data stored in the storage unit into a R component, a G component and a B component; and

a gain adjustment unit that conducts gain adjustment of at least one of the R component, the G component and the B component using the calculated gain adjustment value.

20. An image pickup device, comprising:

a remote control device that is configured to be capable of emitting a signal;

an image pickup unit that converts an image projected by an optical system into image data and outputs the image data;

a storage unit that stores the image data output from the image pickup unit;

a detection unit that detects an emission position of the signal emitted from the remote control device from the image data stored in the storage unit; and

a focus control unit that sets an area as a target of focus adjustment based on the detected emission position of the signal and adjusts a focus of the optical system so as to maximize a frequency component within a preset frequency band of image data of the area as the target of the focus adjustment.

21. An image pickup device, comprising:

a remote control device that is configured to be capable of emitting a signal;

an image pickup unit that converts an image projected by an optical system into image data and outputs the image data;

a storage unit that stores the image data output from the image pickup unit;

a detection unit that detects an emission position of the signal emitted from the remote control device from the image data stored in the storage unit; and

an exposure control unit that sets an area as a target of exposure adjustment based on the detected emission position of the signal and conducts the exposure adjustment with reference to brightness of the area as the target of the exposure adjustment.

22. An image pickup method using an image pickup element that converts an image projected by an optical system into image data, comprising the steps of:

(a) outputting the image data converted by the image pickup element;

(b) storing the output image data into a storage device;

(c) detecting an emission position of a signal emitted from an external device from the image data stored in the storage device; and

(d) setting an area as a target of focus adjustment based on the detected emission position of the signal and adjusting a focus of the optical system so as to maximize a frequency component within a preset frequency band of image data of the area as the target of the focus adjustment.

23. The image pickup method according to claim 22, wherein the external device emits a light beam as the signal.

24. The image pickup method according to claim 22, further comprising the step of:

cutting an image displayed in accordance with the image data stored in the storage unit to be in a preset size,

wherein the cutting is conducted so that the emission position of the signal detected in the step (c) is located at the center of the cut image or becomes close to the center of the cut image.

25. The image pickup method according to claim 22, further comprising the step of:

setting an area as an object of exposure adjustment based on the detected emission position of the signal, and conducting the exposure adjustment with reference to brightness of the area as the target of the exposure adjustment.

26. The image pickup method according to claim 22,

wherein the external device comprises a case provided with a portion in a preset reference color, and

the image pickup method further comprises the step of conducting adjustment of white balance with reference to the reference color.

27. The image pickup method according to claim 26,

wherein the step of conducting the adjustment of white balance comprises the steps of:

extracting image data of an area including the portion in the reference color from the image data stored in the storage unit;

calculating a gain adjustment value based on the extracted image data of the area including the portion in the reference color, the gain adjustment value being for making a RGB ratio of an average color of the area including the portion in the reference color a preset ratio;

separating the image data stored in the storage unit into a R component, a G component and a B component; and

conducting gain adjustment of at least one of the R component, the G component and the B component using the calculated gain adjustment value.

28. An image pickup method using an image pickup element that converts an image projected by an optical system into image data, comprising the steps of:

(a) outputting the image data converted by the image pickup element;

(b) storing the output image data into a storage device;

(c) detecting an emission position of a signal emitted from an external device from the image data stored in the storage device; and

(d) setting an area as a target of exposure adjustment based on the detected emission position of the signal and conducting the exposure adjustment with reference to brightness of the area as the target of the exposure adjustment.

29. The image pickup method according to claim 28, wherein the external device emits a light beam as the signal.

30. The image pickup method according to claim 28, further comprising the step of:

cutting an image displayed in accordance with the image data stored in the storage unit to be in a preset size,

wherein the cutting is conducted so that the emission position of the signal detected in the step (c) is located at the center of the cut image or becomes close to the center of the cut image.

31. The image pickup method according to claim 28,

wherein the external device comprises a case provided with a portion in a preset reference color, and

the image pickup method further comprises the step of conducting adjustment of white balance with reference to the reference color.

32. The image pickup method according to claim 31,

wherein the step of conducting the adjustment of white balance comprises the steps of:

extracting image data of an area including the portion in the reference color from the image data stored in the storage unit;

calculating a gain adjustment value based on the extracted image data of the area including the portion in the reference color, the gain adjustment value being for making a RGB ratio of an average color of the area including the portion in the reference color a preset ratio;

separating the image data stored in the storage unit into a R component, a G component and a B component; and

conducting gain adjustment of at least one of the R component, the G component and the B component using the calculated gain adjustment value.

33. A computer program product comprising a program recorded in a recording medium, the program making a computer execute image pickup using an image pickup element that converts an image projected by an optical system into image data, wherein the program recorded in the recording medium contains commands that make the computer execute the steps of:

(a) outputting the image data converted by the image pickup element;

(b) storing the output image data into a storage device;

(c) detecting an emission position of a signal emitted from an external device from the image data stored in the storage device; and

(d) setting an area as a target of focus adjustment based on the detected emission position of the signal and adjusting a focus of the optical system so as to maximize a frequency component within a preset frequency band of image data of the area as the target of the focus adjustment.

34. The computer program product according to claim 33, wherein the external device emits a light beam as the signal.

35. The computer program product according to claim 33,

wherein the program further contains a command that makes the computer execute the step of cutting an image displayed in accordance with the image data stored in the storage unit to be in a preset size,

wherein the cutting is conducted so that the emission position of the signal detected in the step (c) is located at the center of the cut image or becomes close to the center of the cut image.

36. The computer program product according to claim 33,

wherein the program further contains a command that makes the computer execute the step of setting an area as an object of exposure adjustment based on the detected emission position of the signal, and conducting the exposure adjustment with reference to brightness of the area as the target of the exposure adjustment.

37. The computer program product according to claim 33,

wherein the external device comprises a case provided with a portion in a preset reference color, and

the program further contains a command that makes the computer execute the step of conducting adjustment of white balance with reference to the reference color.

38. The computer program product according to claim 37,

wherein the step of conducting the adjustment of white balance comprises the steps of:

extracting image data of an area including the portion in the reference color from the image data stored in the storage unit;

calculating a gain adjustment value based on the extracted image data of the area including the portion in the reference color, the gain adjustment value being for making a RGB ratio of an average color of the area including the portion in the reference color a preset ratio;

separating the image data stored in the storage unit into a R component, a G component and a B component; and

conducting gain adjustment of at least one of the R component, the G component and the B component using the calculated gain adjustment value.

39. A computer program product comprising a program recorded in a recording medium, the program making a computer execute image pickup using an image pickup element that converts an image projected by an optical system into image data, wherein the program recorded in the recording medium contains commands that make the computer execute the steps of:

(a) outputting the image data converted by the image pickup element;

(b) storing the output image data into a storage device;

(c) detecting an emission position of a signal emitted from an external device from the image data stored in the storage device; and

(d) setting an area as a target of exposure adjustment based on the detected emission position of the signal and conducting the exposure adjustment with reference to brightness of the area as the target of the exposure adjustment.

40. The computer program product according to claim 39, wherein the external device emits a light beams as the signal.

41. The computer program product according to claim 39,

wherein the program further contains a command that makes the computer execute the step of cutting an image displayed in accordance with the image data stored in the storage unit to be in a preset size,

wherein the cutting is conducted so that the emission position of the signal detected in the step (c) is located at the center of the cut image or becomes close to the center of the cut image.

42. The computer program product according to claim 39,

wherein the external device comprises a case provided with a portion in a preset reference color, and

the program further contains a command that makes the computer execute the step of conducting adjustment of white balance with reference to the reference color.

43. The computer program product according to claim 42,

wherein the step of conducting the adjustment of white balance comprises the steps of:

extracting image data of an area including the portion in the reference color from the image data stored in the storage unit;

calculating a gain adjustment value based on the extracted image data of the area including the portion in the reference color, the gain adjustment value being for making a RGB ratio of an average color of the area including the portion in the reference color a preset ratio;

separating the image data stored in the storage unit into a R component, a G component and a B component; and

conducting gain adjustment of at least one of the R component, the G component and the B component using the calculated gain adjustment value.