Image processing apparatus, computer readable medium storing program, image processing method, method for producing dynamic image, and printer

• US 20030184826A1
• Filed: 03/26/2003
• Published: 10/02/2003
• Est. Priority Date: 03/29/2002
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Takemoto, Fumito, Hirose, Haruto
• Granted Patent: US 7,304,768 B2
• Time in Patent Office: Days
• US Class Current: 358/518
• CPC Class Codes: H04N 1/6086 by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature
• CPC Class Codes: H04N 21/4117 for generating hard copies of the content, e.g. printer, electronic paper interfaces to printers G06F3/12; printing data G06K15/02
• CPC Class Codes: H04N 21/4318 by altering the content in the rendering process, e.g. blanking, blurring or masking an image region image enhancement or restoration in general G06T5/00
• CPC Class Codes: H04N 21/4332 by placing content in organized collections, e.g. local EPG data repository interfaces, Database management systems or updating for information retrieval G06F16/23; details of retrieval of video data and associated meta data in video database G06F16/739
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 23/82 for controlling camera response irrespective of the scene brightness, e.g. gamma correction
• CPC Class Codes: H04N 23/88 for colour balance, e.g. white-balance circuits or colour temperature control
• CPC Class Codes: H04N 5/14 Picture signal circuitry for video frequency region cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/147 Scene change detection
• CPC Class Codes: H04N 5/20 Circuitry for controlling amplitude response
• CPC Class Codes: H04N 5/202 Gamma control circuits for controlling camera response irrespective of the scene brightness H04N23/82
• CPC Class Codes: H04N 5/57 Control of contrast or brightness
• CPC Class Codes: H04N 5/60 for the sound signals
• CPC Class Codes: H04N 9/69 for modifying the colour signals by gamma correction controlling camera response for colour signals H04N23/83
• CPC Class Codes: H04N 9/73 Colour balance circuits, e.g. white balance circuits or colour temperature control camera processing pipelines for colour balance H04N23/88

Abstract

An image processing apparatus which performs correction processing on a dynamic image including a plurality of frame images for determining the correction value suitable for each of the frame images of the dynamic image including: a detector detecting change of scenes of the dynamic image; a correction value determination unit determining the correction value for image processing of each of the plurality of frame images based on the change of the scenes detected by the detector; and a correction unit correcting each of the frame images of the dynamic image based on the correction value determined by the correction value determination unit.

Claims

1. An image processing apparatus for performing correction processing on a dynamic image including a plurality of frame images, comprising:

a correction value determination unit determining the correction value for image processing on each of the frame images; and

a correction unit correcting each of the frame images of the dynamic image based on the correction value determined by said correction value determination unit.

2. The image processing apparatus as claimed in claim 1, wherein

said correction value determination unit determines correction value for each of the plurality of frame images respectively, and

said correction unit corrects each of the frame images based on the correction values determined by said correction value determination unit.

3. The image processing apparatus as claimed in claim 2, wherein

said correction value determination unit determines the correction values of frame images every predetermined number of frames among the plurality of frame images, and

said correction unit corrects each of the frame images based on the correction values determined by said correction value determination unit.

4. The image processing apparatus as claimed in claim 2, wherein said correction value determination unit determines the correction values of frame images every predetermined interval among the plurality of frame images, and determines the correction values of frame images, which are sandwiched between the two frame images on which the correction values are determined by said correction value determination unit, based on the correction value of the two frame images.

5. The image processing apparatus as claimed in claim 4, wherein said correction value determination unit determines the correction values of frame images every predetermined number of seconds among the plurality of frame images, and determines the correction values of frame images, which are sandwiched between the two frame images on which the correction values are determined by said correction value determination unit, based on the correction value of the two frame images.

6. The image processing apparatus as claimed in claim 4, wherein said correction value determination unit determines the correction values of frame images every predetermined number of frames among the plurality of frame images, and determines the correction values of frame images, which are sandwiched between the two frame images on which the correction values are determined by said correction value determination unit, based on the correction value of the two frame images.

7. The image processing apparatus as claimed in claim 4, wherein said correction value determination unit determines the correction values of frame images which are sandwiched between the two frame images on which the correction values are determined by said correction value determination unit, by interpolating between the two frame images.

8. The image processing apparatus as claimed in claim 4, further comprising

a detection unit detecting change of scenes of the dynamic image, and wherein

said correction value determination unit determines the correction value of a frame image immediately after the change of the scenes and another frame image after a predetermined interval from the frame image, and determines the correction values of frame images, which are sandwiched between the two frame images on which the correction values are determined by said correction value determination unit, based on the correction value of the two frame images.

9. The image processing apparatus as claimed in claim 2 further comprising

a detection unit detecting change of scenes of the dynamic image, and wherein

said correction value determination unit determines a correction value for each of the scenes based on the change of the scenes detected by said detection unit.

10. The image processing apparatus as claimed in claim 9, wherein

if difference of a first color component, a second color component or a third color component between the frame image and another frame image immediately before the frame image is larger than a predetermined value, said detection unit judges that the scenes are changed between the two frame images.

11. The image processing apparatus as claimed in claim 10, wherein said color components are a C (cyan) component, an M (magenta) component, and a Y (yellow) component.

12. The image processing apparatus as claimed in claim 10, wherein said color components are hue, color saturation, and lightness.

13. The image processing apparatus as claimed in claim 10,

wherein said color components are an R (red) component, a G (green) component, and a B (blue) component.

14. The image processing apparatus as claimed in claim 9, wherein

the dynamic image is an image of a subject captured by the image capturing apparatus, and

if the difference of distance from the subject of the frame image to the image capturing apparatus between the frame image and a frame image immediately before the frame image is larger than a predetermined value, said detection unit judges that the scenes are changed between the two frame images.

15. The image processing apparatus as claimed in claim 1, further comprising

an incidental information acquisition unit acquiring incidental information about each of the frame images, and wherein

said correction value determination unit determines the correction value based on the incidental information acquired by said incidental information acquisition unit.

16. The image processing apparatus as claimed in claim 15, wherein said incidental information acquisition unit acquires photography time of each of the frame images as the incidental information.

17. The image processing apparatus as claimed in claim 15, wherein said incidental information acquisition unit acquires photography location of each of the frame images as the incidental information.

18. The image processing apparatus as claimed in claim 15, wherein the dynamic image is an image of a subject captured by the image capturing apparatus, and said incidental information acquisition unit acquires information indicating distance from the subject of each of the frame images to the image capturing apparatus as the incidental information.

19. The image processing apparatus as claimed in claim 15, wherein the dynamic image is an image of a subject captured by the image capturing apparatus, and said incidental information acquisition unit acquires information indicating brightness of each of the frame images as the incidental information.

20. The image processing apparatus as claimed in claim 1, wherein

the dynamic image further includes sound information, and the image processing apparatus further comprises:

a sound information acquisition unit acquiring the sound information; and

a sound information analysis unit analyzing sound source of the sound information, and

said correction value determination unit determines the correction value based on the information indicating the sound source analyzed by said sound information analysis unit.

21. The image processing apparatus as claimed in claim 1, wherein

said correction value determination unit determines the correction value for white balance correction of each of the frame images, and

said correction unit performs white balance correction on each of the frame images of the dynamic image based on the correction value.

22. The image processing apparatus as claimed in claim 1, wherein

said correction value determination unit determines the correction value for gamma correction of each of the frame images, and

said correction unit performs gamma correction on each of the frame images of the dynamic image based on the correction value.

23. The image processing apparatus as claimed in claim 1, wherein

said correction value determination unit determines the correction value for brightness correction of each of the frame images, and

said correction unit performs brightness correction on each of the frame images of the dynamic image based on the correction value.

24. The image processing apparatus as claimed in claim 1, wherein

said correction value determination unit determines the correction value for edge enhancement correction for each of the frame images, and

said correction unit performs edge enhancement correction on each of the frame images of the dynamic image based on the correction value.

25. A computer readable medium storing thereon a program for performing correction processing on a dynamic image including a plurality of frame images, the program comprising:

a correction value determination module causing computer to determine the correction value for image processing on each of the frame images; and

a correction module causing computer to correct each of the frame images of the dynamic image based on the determined correction value.

26. The computer readable medium storing thereon a program as claimed in claim 25, wherein

said correction value determination module causes computer to determine correction value for each of the plurality of frame images respectively, and

said correction module causes computer to correct each of the frame images based on the correction values caused to determine by said correction value determination module.

27. The computer readable medium storing thereon a program as claimed in claim 26, wherein

said correction value determination module causes computer to determine the correction values of frame images every predetermined number of frames among the plurality of frame images, and

said correction module causes computer to correct each of the frame images based on the correction values caused to determine by said correction value determination module.

28. The computer readable medium storing thereon a program as claimed in claim 26, wherein said correction value determination module causes computer to determine the correction values of frame images every predetermined interval among the plurality of frame images, and causes computer to determine the correction values of frame images, which are sandwiched between the two frame images on which the correction values are caused to determine by said correction value determination module, based on the correction value of the two frame images.

29. The computer readable medium storing thereon a program as claimed in claim 28, wherein said correction value determination module causes computer to determine the correction values of frame images every predetermined number of seconds among the plurality of frame images, and causes computer to determine the correction values of frame images, which are sandwiched between the two frame images on which the correction values are caused to determine by said correction value determination module, based on the correction value of the two frame images.

30. The computer readable medium storing thereon a program as claimed in claim 28, wherein said correction value determination module causes computer to determine the correction values of frame images every predetermined number of frames among the plurality of frame images, and causes computer to determine the correction values of frame images, which are sandwiched between the two frame images on which the correction values are caused to determine by said correction value determination module, based on the correction value of the two frame images.

31. The computer readable medium storing thereon a program as claimed in claim 28, wherein said correction value determination module causes computer to determine the correction values of frame images which are sandwiched between the two frame images on which the correction values are caused to determine by said correction value determination module, by interpolating between the two frame images.

32. The computer readable medium storing thereon a program as claimed in claim 28, further comprising

a detection module causing computer to detect change of scenes of the dynamic image, and wherein

said correction value determination module causes computer to determine the correction value of a frame image immediately after the change of the scenes and another frame image after a predetermined interval from the frame image, and causes computer to determine the correction values of frame images, which are sandwiched between the two frame images on which the correction values are caused to determine by said correction value determination module, based on the correction value of the two frame images.

33. The computer readable medium storing thereon a program as claimed in claim 26 further comprising

a detection module causing computer to detect change of scenes of the dynamic image, and wherein

said correction value determination module causes computer to determine a correction value for each of the scenes based on the change of the scenes caused to detect by said detection module.

34. The computer readable medium storing thereon a program as claimed in claim 33, wherein

if difference of a first color component, a second color component or a third color component between the frame image and another frame image immediately before the frame image is larger than a predetermined value, said detection module causes computer to judge that the scenes are changed between the two frame images.

35. The computer readable medium storing thereon a program as claimed in claim 34, wherein said color components are a C (cyan) component, an M (magenta) component, and a Y (yellow) component.

36. The computer readable medium storing thereon a program as claimed in claim 34, wherein said color components are hue, color saturation, and lightness.

37. The computer readable medium storing thereon a program as claimed in claim 34, wherein said color components are an R (red) component, a G (green) component, and a B (blue) component.

38. The computer readable medium storing thereon a program as claimed in claim 33, wherein

the dynamic image is an image of a subject captured by an image capturing apparatus, and

if the difference of distance from the subject of the frame image to the image capturing apparatus between the frame image and a frame image immediately before the frame image is larger than a predetermined value, said detection module causes computer to judge that the scenes are changed between the two frame images.

39. The computer readable medium storing thereon a program as claimed in claim 25, further comprising

an incidental information acquisition module causing computer to acquire incidental information about each of the frame images, and wherein

said correction value determination module causes computer to determine the correction value based on the incidental information caused to acquire by said incidental information acquisition module.

40. The computer readable medium storing thereon a program as claimed in claim 39, wherein said incidental information acquisition module causes computer to acquire photography time of each of the frame images as the incidental information.

41. The computer readable medium storing thereon a program as claimed in claim 39, wherein said incidental information acquisition module causes computer to acquire photography location of each of the frame images as the incidental information.

42. The computer readable medium storing thereon a program as claimed in claim 39, wherein the dynamic image is an image of a subject captured by the image capturing apparatus, and said incidental information acquisition module causes computer to acquire information indicating distance from the subject of each of the frame images to the image capturing apparatus as the incidental information.

43. The computer readable medium storing thereon a program as claimed in claim 39, wherein the dynamic image is an image of a subject captured by the image capturing apparatus, and said incidental information acquisition module causes computer to acquire information indicating brightness of each of the frame images as the incidental information.

44. The computer readable medium storing thereon a program as claimed in claim 25, wherein

the dynamic image further includes sound information, and the computer readable medium storing thereon a program further comprises:

a sound information acquisition module causing computer to acquire the sound information; and

a sound information analysis module causing computer to analyze sound source of the sound information, and

said correction value determination module causes computer to determine the correction value based on the information indicating the sound source caused to analyze by said sound information analysis module.

45. The computer readable medium storing thereon a program as claimed in claim 25, wherein

said correction value determination module causes computer to determine the correction value for white balance correction of each of the frame images, and

said correction module causes computer to perform white balance correction on each of the frame images of the dynamic image based on the correction value.

46. The computer readable medium storing thereon a program as claimed in claim 25, wherein

said correction value determination module causes computer to determine the correction value for gamma correction of each of the frame images, and

said correction module causes computer to perform gamma correction on each of the frame images of the dynamic image based on the correction value.

47. The computer readable medium storing thereon a program as claimed in claim 25, wherein

said correction value determination module causes computer to determine the correction value for brightness correction of each of the frame images, and

said correction module causes computer to perform brightness correction on each of the frame images of the dynamic image based on the correction value.

48. The computer readable medium storing thereon a program as claimed in claim 25, wherein

said correction value determination module causes computer to determine the correction value for edge enhancement correction for each of the frame images, and

said correction module causes computer to perform edge enhancement correction on each of the frame images of the dynamic image based on the correction value.

49. An image processing method for performing correction processing on a dynamic image including a plurality of frame images, comprising steps of:

determining the correction value for image processing on each of the frame images; and

correcting each of the frame images of the dynamic image based on the determined correction value.

50. A method for producing a dynamic image including a plurality of frame images, comprising steps of:

acquiring a dynamic image;

determining a correction value of each of the frame images included in the acquired dynamic image; and

correcting each of the frame images included in the dynamic image based on the determined correction value.

51. A printer for printing a frame image included in a dynamic image, comprising:

an image acquisition unit acquiring the frame image;

a receiving unit receiving information about a correction value of the frame image from an image processing apparatus determining the correction value used for image processing of the dynamic image;

a correction value calculating unit calculating information about a correction value used by the printer based on information about the correction value received by said receiving unit; and

a correction unit correcting the frame image based on information about the correction value calculated by said correction value calculating unit.