Image processing device executing image processing on input image and processing method for the same

• US 20040131247A1
• Filed: 03/19/2003
• Published: 07/08/2004
• Est. Priority Date: 01/07/2003
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Hiwada, Kazuhiro
• Granted Patent: US 7,239,741 B2
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06V 20/647 by matching two-dimensional images to three-dimensional objects
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

An image processing device is composed of an image drawing section, an image input section, a corresponding-point searching section, and a processing parameter improving section. The image drawing section has a preset three-dimensional model image to draw a three-dimensional image on the basis of the three-dimensional model image and a first processing parameter. An input image of a still image or a motion picture is input to the image input section. The corresponding-point searching section searches for that point on the input image input to the image input section which corresponds to a certain point on the three-dimensional image drawn by the image drawing section, to obtain corresponding-point position information. The processing parameter improving section uses the corresponding-point position information obtained by the corresponding-point searching section to improve a value for the first processing parameter to determine a second processing parameter.

Claims

1. An image processing device comprising:

an image drawing section which has a preset three-dimensional model image to draw a three-dimensional image on the basis of the three-dimensional model image and a first processing parameter;

an image input section to which an input image of a still image or a motion picture is input;

a corresponding-point searching section which searches for that point on the input image input to the image input section which corresponds to a certain point on the three-dimensional image drawn by the image drawing section, to obtain corresponding-point position information; and

a processing parameter improving section which uses the corresponding-point position information obtained by the corresponding-point searching section to improve a value for the first processing parameter to determine a second processing parameter.

2. An image processing device according to claim 1, wherein the corresponding-point searching section obtains the corresponding-point position information by arranging a plurality of points on the three-dimensional image and searching for a point on the input image which corresponds to each of the plurality of points.

3. An image processing device according to claim 2, wherein when the image drawing section has drawn a three-dimensional image on the basis of the three-dimensional model image and the second processing parameter, the processing parameter improving section determines the second processing parameter so as to minimize the distance between two corresponding points for the plurality of points arranged on the three-dimensional image and the corresponding plurality of points on the input image.

4. An image processing device according to claim 1, wherein the second processing parameter determined by the processing parameter improving section is input to the image drawing section,

the image drawing section draws a three-dimensional image on the basis of the three-dimensional model image and the second processing parameter,

the corresponding-point searching section obtains corresponding-point position information on the three-dimensional image and the input image, and

the processing parameter improving section uses the corresponding-point position information to improve a value for the second processing parameter to determine a third processing parameter.

5. An image processing device according to claim 4, further comprising an image output section which externally outputs the three-dimensional image drawn by the image drawing section on the basis of the three-dimensional model image and the third processing parameter.

6. An image processing device according to claim 1, wherein the image drawing section and the corresponding-point searching section are formed on a single semiconductor substrate.

7. An image processing device according to claim 6, wherein the processing parameter improving section is further formed on the semiconductor substrate.

8. An image processing device according to claim 1, further comprising a network connecting section which outputs the second processing parameter determined by the processing parameter improving section, to a network.

9. An image processing device according to claim 8, wherein the network connecting section receives the first processing parameter from the network and outputs the first processing parameter to the image drawing section.

10. An image processing device according to claim 5, wherein if the input image input to the image input section is an image of a person, the image output section outputs an avatar image for movement, posture, or expression approximating to that in the image of the person.

11. An image processing device comprising:

a model image creating section which uses an input image of a still image or a motion picture to create a three-dimensional model image and a first processing parameter;

an image drawing section which draws a three-dimensional image on the basis of the three-dimensional model image and first processing parameter created by the model image creating section;

an image input section to which the input image of the still image or the motion picture is input;

a corresponding-point searching section which searches for that point on the input image input to the image input section which corresponds to a certain point on the three-dimensional image drawn by the image drawing section, to obtain corresponding-point position information; and

a processing parameter improving section which uses the corresponding-point position information obtained by the corresponding-point searching section to improve a value for the first processing parameter to determine a second processing parameter.

12. An image processing device according to claim 11, wherein the corresponding-point searching section obtains the corresponding-point position information by arranging a plurality of points on the three-dimensional image and searching for a point on the input image which corresponds to each of the plurality of points.

13. An image processing device according to claim 12, wherein when the image drawing section has drawn the three-dimensional image on the basis of the three-dimensional model image and the second processing parameter, the processing parameter improving section determines the second processing parameter so as to minimize the distance between two corresponding points for the plurality of points arranged on the three-dimensional image and the corresponding plurality of points on the input image.

14. An image processing device according to claim 11, wherein the second processing parameter determined by the processing parameter improving section is input to the image drawing section,

the image drawing section draws a three-dimensional image on the basis of the three-dimensional model image and the second processing parameter,

the corresponding-point searching section obtains corresponding-point position information on the three-dimensional image and the input image, and

the processing parameter improving section uses the corresponding-point position information to improve a value for the second processing parameter to determine a third processing parameter.

15. An image processing device according to claim 14, further comprising an image output section which externally outputs the three-dimensional image drawn by the image drawing section on the basis of the three-dimensional model image and the third processing parameter.

16. An image processing device according to claim 11, wherein the image drawing section and the corresponding-point searching section are formed on a single semiconductor substrate.

17. An image processing device according to claim 16, wherein the processing parameter improving section is further formed on the semiconductor substrate.

18. An image processing device according to claim 11, further comprising a network connecting section which outputs the second processing parameter determined by the processing parameter improving section, to a network.

19. An image processing device according to claim 18, wherein the network connecting section receives the first processing parameter from the network and outputs the first processing parameter to the image drawing section.

20. An image processing device according to claim 15, wherein if the input image input to the image input section is an image of a person, the image output section outputs an avatar image for movement, posture, or expression approximating to that in the image of the person.

21. An image processing method comprising:

drawing a three-dimensional image on the basis of a three-dimensional model image and a first processing parameter;

receiving an input image of a still image or a motion picture;

searching for a point on the input image which corresponds to a certain point on the three-dimensional image to obtain corresponding-point position information; and

using the corresponding-point position information obtained to improve a value for the first processing parameter to determine a second processing parameter.

22. An image processing method according to claim 21, wherein the corresponding-point position information is obtained by arranging a plurality of points on the three-dimensional image and searching for a point on the input image which corresponds to each of the plurality of points.

23. An image processing method according to claim 22, wherein the second processing parameter is calculated so as to minimize the distance between two corresponding points for the plurality of points arranged on the three-dimensional image and the corresponding plurality of points on the input image, when the three-dimensional image is drawn on the basis of the three-dimensional model image and the second processing parameter.

24. An image processing method according to claim 21, wherein a three-dimensional image is drawn on the basis of the three-dimensional model image and the second processing parameter,

corresponding-point position information is obtained on the three-dimensional image and the input image, and

the corresponding-point position information is used to improve a value for the second processing parameter to determine a third processing parameter.

25. An image processing method according to claim 24, wherein the three-dimensional image drawn on the basis of the three-dimensional model image and the third processing parameter is externally output.

26. An image processing method according to claim 21, wherein the second processing parameter is output to a network.

27. An image processing method according to claim 21, wherein the first processing parameter is input from a network.

28. An image processing method according to claim 21, wherein if the input image is an image of a person, an avatar image for movement, posture, or expression approximating to that in the image of the person is output.

29. An image processing method comprising:

using an input image of a still image or a motion picture to create a three-dimensional model image and a first processing parameter;

drawing a three-dimensional image on the basis of the three-dimensional model image and the first processing parameter;

receiving the input image of the still image or the motion picture;

searching for a point on the input image which corresponds to a certain point on the three-dimensional image to obtain corresponding-point position information; and

using the corresponding-point position information obtained to improve a value for the first processing parameter to determine a second processing parameter.

30. An image processing method according to claim 29, wherein the corresponding-point position information is obtained by arranging a plurality of points on the three-dimensional image and searching for a point on the input image which corresponds to each of the plurality of points.

31. An image processing method according to claim 30, wherein the second processing parameter is calculated so as to minimize the distance between two corresponding points for the plurality of points arranged on the three-dimensional image and the corresponding plurality of points on the input image, when the three-dimensional image is drawn on the basis of the three-dimensional model image and the second processing parameter.

32. An image processing method according to claim 29, wherein a three-dimensional image is drawn on the basis of the three-dimensional model image and the second processing parameter,

corresponding-point position information is obtained on the three-dimensional image and the input image, and

the corresponding-point position information is used to improve a value for the second processing parameter to determine a third processing parameter.

33. An image processing method according to claim 32, wherein the three-dimensional image drawn on the basis of the three-dimensional model image and the third processing parameter is externally output.

34. An image processing method according to claim 29, wherein the second processing parameter is output to a network.

35. An image processing method according to claim 29, wherein the first processing parameter is input from a network.

36. An image processing method according to claim 29, wherein if the input image is an image of a person, an avatar image for movement, posture, or expression approximating to that in the image of the person is output.