Imaging apparatus and control method thereof

• US 20080218603A1
• Filed: 03/03/2008
• Published: 09/11/2008
• Est. Priority Date: 03/05/2007
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Oishi, Makoto
• Granted Patent: US 7,995,106 B2
• Time in Patent Office: Days
• US Class Current: 348/231.99
• CPC Class Codes: H04N 1/00132 in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
• CPC Class Codes: H04N 1/00183 Photography assistance, e.g. displaying suggestions to the user
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence
• CPC Class Codes: H04N 7/0122 the input and the output signals having different aspect ratios
• CPC Class Codes: H04N 9/8047 using transform coding
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8211 the additional signal being a sound signal H04N9/835 takes precedence
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal
• CPC Class Codes: H04N 9/8715 involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal

Abstract

A digital camera has human extraction means, non-human extraction means, and composition judgment means. The human extraction means extracts a human figure region by analysis of image data. The non-human extraction means extracts a major subject other than a human figure by analysis of a region other than the human figure region having been extracted by the human extraction means. The composition judgment means evaluates arrangement of the human figure and the major subject according to results of the extraction, and judges whether composition is appropriate. Based on whether the composition is appropriate, timing to record the image data is determined. Preferably, recording means is controlled so as to record the image data at the determined timing, or the timing is notified to a user.

Claims

1. An imaging apparatus comprising:

imaging means for generating image data representing a scene by photography of the scene;

recording means for recording the image data generated by the imaging means in a predetermined recording medium;

human extraction means for carrying out extraction of an image region or image regions representing a human figure or human figures by analyzing the image data generated by the imaging means;

non-human extraction means for carrying out extraction of a major subject other than the human figure or figures by analyzing an image region other than the image region or regions extracted by the human extraction means from the image data generated by the imaging means;

composition judgment means for carrying out evaluation of whether an arrangement of the human figure or figures and the major subject other than the human figure or figures satisfies a predetermined condition according to a result of the extraction by the human extraction means and a result of the extraction by the non-human extraction means, and for carrying out judgment as to whether composition of the image data is appropriate according to the evaluation of the arrangement; and

recording timing determination means for determining timing to record the image data, based on a result of the judgment by the composition judgment means.

2. The imaging apparatus according to claim 1, further comprising recording control means for controlling the recording means so as to record the image data at the timing determined by the recording timing determination means.

3. The imaging apparatus according to claim 1, further comprising notification means for notifying the timing determined by the recording timing determination means.

4. The imaging apparatus according to claim 1, further comprising:

composition proposing means for determining an arrangement of the human figure or figures and the major subject that satisfies the predetermined condition by using the results of the extraction by the human extraction means and the non-human extraction means; and

photography control means for controlling an operation of the imaging means so as to generate image data in which the human figure or figures and the major subject are laid out in the arrangement determined by the composition proposing means.

5. The imaging apparatus according to claim 1, further comprising:

composition proposing means for determining an arrangement of the human figure or figures and the major subject that satisfies the predetermined condition by using the results of the extraction by the human extraction means and the non-human extraction means; and

image processing means for carrying out image processing on the image data so as to cause the arrangement of the human figure or figures and the major subject to agree with the arrangement determined by the composition proposing means.

6. The imaging apparatus according to claim 1, wherein the recording means records the results of the extraction by the human extraction means and the non-human extraction means together with the image data in the recording medium.

7. The imaging apparatus according to claim 1, wherein the human extraction means carries out human face search in the image data, and outputs information representing the number of human faces detected through the search and a position and a size of each of the human faces as the result of the extraction.

8. The imaging apparatus according to claim 7, wherein the human extraction means recognizes a facial expression of the face or faces detected in the search and further outputs information representing the recognized facial expression.

9. The imaging apparatus according to claim 1, wherein the human extraction means recognizes a gesture of the human figure or figures included in the image data and outputs information representing the recognized gesture as the result of the extraction.

10. The imaging apparatus according to claim 1, wherein the non-human extraction means extracts the major subject by carrying out filtering processing using a high-pass filter on the image data.

11. The imaging apparatus according to claim 1, wherein the non-human extraction means extracts a predetermined pre-registered target as the major subject by recognizing the target among targets included in the image data.

12. The imaging apparatus according to claim 1, further comprising voice analysis means for carrying out detection of a predetermined characteristic related to a voice by analysis of an inputted voice, wherein

the composition judgment means carries out the judgment as to whether the composition of the image data is appropriate, based on the predetermined characteristic detected by the voice analysis means and the evaluation of the arrangement.

13. The imaging apparatus according to claim 12, wherein the recording means records the results of the extraction by the human extraction means and the non-human extraction means and a result of the detection by the voice analysis means in the recording medium, together with the image data.

14. The imaging apparatus according to claim 12, wherein the voice analysis means detects a predetermined volume change as the predetermined characteristic.

15. The imaging apparatus according to claim 12, wherein the voice analysis means detects a predetermined phrase as the predetermined characteristic.

16. The imaging apparatus according to claim 12, wherein the voice analysis means detects a characteristic that has been pre-registered as a characteristic of a voice of a predetermined person as the predetermined characteristic.

17. A control method of an imaging apparatus having imaging means for generating image data representing a scene by photography of the scene and recording means for recording the image data generated by the imaging means in a predetermined recording medium, the method comprising the steps of:

extracting an image region representing a human figure by analysis of the image data generated by the imaging means;

extracting a major subject other than the human figure by analysis of an image region other than the image region representing the human figure in the image data generated by the imaging means;

carrying out evaluation of whether an arrangement of the extracted human figure and the major subject satisfies a predetermined condition;

carrying out judgment as to whether composition of the image data is appropriate, based on the evaluation of the arrangement; and

determining timing of recording the image data, based on a result of the judgment on the composition.

18. The control method of the imaging apparatus according to claim 17, further comprising the step of controlling the recording means so as to record the image data at the determined timing.

19. The control method of the imaging apparatus according to claim 17, further comprising the step of notifying a user of the determined timing by control of an operation of predetermined output means.

20. An imaging apparatus comprising:

imaging means for generating image data representing a scene by photography of the scene;

recording means for recording the image data generated by the imaging means in a predetermined recording medium;

human extraction means for carrying out extraction of an image region or image regions representing a human figure or human figures by analyzing the image data generated by the imaging means;

voice analysis means for carrying out detection of a predetermined characteristic related to a voice by analysis of an inputted voice;

composition judgment means for carrying out judgment as to whether composition of the image data is appropriate, based on a result of the extraction by the human extraction means and a result of the detection by the voice analysis means; and

recording timing determination means for determining timing of recording the image data, based on a result of the judgment by the composition judgment means.

21. The imaging apparatus according to claim 20, further comprising recording control means for controlling the recording means so as to record the image data at the timing determined by the recording timing determination means.

22. The imaging apparatus according to claim 20, further comprising notification means for notifying the timing determined by the recording timing determination means.

23. The imaging apparatus according to claim 20, wherein the recording means records the result of the extraction by the human extraction means and the result of the detection by the voice analysis means together with the image data in the recording medium.

24. The imaging apparatus according to claim 20, wherein the voice analysis means detects a predetermined volume change as the predetermined characteristic.

25. The imaging apparatus according to claim 20, wherein the voice analysis means detects a predetermined phrase as the predetermined characteristic.

26. The imaging apparatus according to claim 20, wherein the voice analysis means detects a characteristic that has been pre-registered as a characteristic of a voice of a predetermined person, as the predetermined characteristic.

27. The imaging apparatus according to claim 20, wherein the human extraction means carries out human face search in the image data, and outputs information representing the number of human faces detected through the search and a position and a size of each of the human faces, as the result of the extraction.

28. The imaging apparatus according to claim 27, wherein the human extraction means recognizes a facial expression of the face or faces detected in the search and further outputs information representing the recognized facial expression.

29. The imaging apparatus according to claim 20, wherein the human extraction means recognizes a gesture of the human figure or figures included in the image data and outputs information representing the recognized gesture as the result of the extraction.

30. A control method of an imaging apparatus having imaging means for generating image data representing a scene by photography of the scene and recording means for recording the image data generated by the imaging means in a predetermined recording medium, the method comprising the steps of:

carrying out extraction of an image region representing a human figure by analysis of the image data generated by the imaging means;

carrying out detection of a predetermined characteristic related to a voice by analysis of an inputted voice;

carrying out judgment as to whether composition of the image data is appropriate, based on a result of the extraction and a result of the detection; and

determining timing to record the image data, based on a result of the judgment.

31. The control method of the imaging apparatus according to claim 30, further comprising the step of controlling the recording means so as to record the image data at the determined timing.

32. The control method of the imaging apparatus according to claim 30, further comprising the step of notifying a user of the determined timing by control of an operation of predetermined output means.

33. An imaging apparatus comprising:

imaging means for generating image data representing a scene by photography of the scene;

recording means for recording the image data generated by the imaging means in a predetermined recording medium;

human extraction means for carrying out extraction of an image region or image regions representing a human figure or human figures by analyzing the image data generated by the imaging means;

non-human extraction means for carrying out extraction of a major subject other than the human figure or figures by analyzing an image region other than the image region or regions extracted by the human extraction means from the image data generated by the imaging means;

composition judgment means for carrying out evaluation of whether an arrangement of the human figure or figures and the major subject other than the human figure or figures satisfies a predetermined condition according to a result of the extraction by the human extraction means and a result of the extraction by the non-human extraction means, and for carrying out judgment as to whether composition of the image data is appropriate according to the evaluation of the arrangement; and

composition proposing means for determining an arrangement of the human figure or figures and the major subject that satisfies the predetermined condition, by using the results of the extraction by the human extraction means and the non-human extraction means.

34. The imaging apparatus according to claim 33, further comprising photography control means for controlling an operation of the imaging means so as to generate image data in which the human figure or figures and the major subject are laid out in the arrangement determined by the composition proposing means.

35. The imaging apparatus according to claim 33, further comprising image processing means for carrying out image processing on the image data so as to cause the arrangement of the human figure or figures and the major subject to agree with the arrangement determined by the composition proposing means.

36. The imaging apparatus according to claim 33, further comprising recording control means for determining timing of recording the image data according to a result of the judgment by the composition judgment means and for controlling the recording means so as to record the image data at the determined timing.

37. The imaging apparatus according to claim 33, further comprising notification means for determining timing of recording the image data according to a result of the judgment by the composition judgment means and for notifying the determined timing.

38. The imaging apparatus according to claim 33, wherein the recording means records the results of the extraction by the human extraction means and the non-human extraction means together with the image data in the recording medium.

39. The imaging apparatus according to claim 33, wherein the human extraction means carries out human face search in the image data, and outputs information representing the number of human faces detected through the search and a position and a size of each of the human faces as the result of the extraction.

40. The imaging apparatus according to claim 39, wherein the human extraction means recognizes a facial expression of the face or faces detected in the search and further outputs information representing the recognized facial expression.

41. The imaging apparatus according to claim 33, wherein the human extraction means recognizes a gesture of the human figure or figures included in the image data and outputs information representing the recognized gesture as the result of the extraction.

42. The imaging apparatus according to claim 33, wherein the non-human extraction means extracts the major subject by carrying out filtering processing using a high-pass filter on the image data.

43. The imaging apparatus according to claim 33, wherein the non-human extraction means extracts a predetermined pre-registered target as the major subject by recognizing the target among targets included in the image data.

44. The imaging apparatus according to claim 33 further comprising voice analysis means for carrying out detection of a predetermined characteristic related to a voice by analysis of an inputted voice, wherein

the composition judgment means carries out the judgment as to whether the composition of the image data is appropriate, based on the predetermined characteristic detected by the voice analysis means and the evaluation of the arrangement.

45. The imaging apparatus according to claim 44, wherein the recording means records the results of the extraction by the human extraction means and the non-human extraction means and a result of the detection by the voice analysis means in the recording medium, together with the image data.

46. The imaging apparatus according to claim 44, wherein the voice analysis means detects a predetermined volume change as the predetermined characteristic.

47. The imaging apparatus according to claim 44, wherein the voice analysis means detects a predetermined phrase as the predetermined characteristic.

48. The imaging apparatus according to claim 44, wherein the voice analysis means detects a characteristic that has been pre-registered as a characteristic of a voice of a predetermined person, as the predetermined characteristic.

49. A control method of an imaging apparatus having imaging means for generating image data representing a scene by photography of the scene and recording means for recording the image data generated by the imaging means in a predetermined recording medium, the method comprising the steps of:

extracting an image region representing a human figure by analysis of the image data generated by the imaging means;

extracting a major subject other than the human figure from the image data generated by the imaging means, by analysis of an image region other than the image region representing the human figure;

carrying out evaluation as to whether an arrangement of the extracted human figure and the major subject satisfies a predetermined condition;

judging whether composition of the image data is appropriate, based on the evaluation of the arrangement; and

determining an arrangement of the extracted human figure and the major subject that satisfies the predetermined condition.

50. The control method of the imaging apparatus according to claim 49, further comprising the step of controlling an operation of the imaging means so as to generate image data in which the human figure and the major subject are arranged in the determined arrangement.

51. The control method of the imaging apparatus according to claim 49, further comprising the step of carrying out image processing on the image data so as to cause the arrangement of the human figure and the major subject to agree with the determined arrangement.