INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM

• US 20140198962A1
• Filed: 01/15/2014
• Published: 07/17/2014
• Est. Priority Date: 01/17/2013
• Status: Active Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Anabuki, Mahoro, Katano, Yasuo, Matsugu, Masakazu, Suzuki, Masahiro
• Granted Patent: US 10,262,199 B2
• Time in Patent Office: Days
• US Class Current: 382/128
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/0014 using an image reference approach
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

In order to reduce limitations on an arrangement of a posture visualization system as a whole, a posture recognition unit recognizes, based on image data of a real space captured by an image capture unit from a predetermined viewpoint, a posture of an object in the image data of the real space. A posture visualization viewpoint setting unit sets a viewpoint different from the predetermined viewpoint. A posture visualization unit visualizes a mirror image of the posture of the object viewed from the viewpoint set by the posture visualization viewpoint setting unit based on the posture recognized by the posture recognition unit. A space display unit displays the mirror image of the posture of the object generated by the posture visualization unit and a mirror image of the real space at once.

Claims

1. An image processing apparatus comprising:

a recognition unit configured to recognize, based on image data of a real space captured by an image capture unit from a predetermined viewpoint, a posture of an object in the image data of the real space;

a setting unit configured to set a viewpoint different from the predetermined viewpoint;

a generation unit configured to generate an image of the posture of the object viewed from the viewpoint set by the setting unit based on the posture recognized by the recognition unit; and

a display control unit configured to display the image of the posture of the object generated by the generation unit on a display unit.

2. The image processing apparatus according to claim 1, wherein the display control unit displays an image of a posture of the object generated by the generation unit and an image of a real space on the display unit.

3. The image processing apparatus according to claim 1, wherein the setting unit derives the predetermined viewpoint based on the posture of the object recognized by the recognition unit, and sets a viewpoint other than the predetermined viewpoint based on the derived predetermined viewpoint.

4. The image processing apparatus according to claim 1, wherein the display unit includes a half mirror or a mirror.

12. The image processing apparatus according to claim 1 further comprising an identification unit configured to identify the object in the image data of the real space based on the image data of the real space captured by the image capture unit,

wherein the recognition unit recognizes the posture of the object based on data related to a body of the object corresponding to an identification result obtained by the identification unit.

5. An image processing apparatus comprising:

a recognition unit configured to recognize, based on image data of a real space captured by an image capture unit from a first viewpoint, a posture of an object in the image data of the real space;

a setting unit configured to set a second viewpoint and a third viewpoint;

a generation unit configured to generate an image of a space in which the posture of the object recognized by the recognition unit viewed from the second viewpoint and an image of the posture of the object viewed from the third viewpoint; and

a display control unit configured to display the image of the space and the image of the posture of the object generated by the generation unit on a display unit.

6. The image processing apparatus according to claim 5, wherein the setting unit sets the second viewpoint based on the first viewpoint and sets the third viewpoint based on the second viewpoint.

7. The image processing apparatus according to claim 5, wherein the display control unit flips the image of the space and the image of the posture of the object viewed from the third viewpoint generated by the generation unit left side right and displays the resultant images on the display unit.

8. The image processing apparatus according to claim 5,

wherein the generation unit, based on posture data indicating a reference posture, generates the reference posture viewed from the third viewpoint, and

wherein the display control unit further displays the reference posture viewed from the third viewpoint generated by the generation unit on the display unit.

9. The image processing apparatus according to claim 8 further comprising a comparison unit configured to compare the posture of the object viewed from the third viewpoint and the reference posture viewed from the third viewpoint,

wherein the display control unit further displays a comparison result of the comparison unit on the display unit.

10. The image processing apparatus according to claim 5 further comprising a recording unit configured to record a result obtained by the generation unit,

wherein the display control unit displays the result recorded in the recording unit on the display unit.

11. The image processing apparatus according to claim 5, wherein the first viewpoint, the second viewpoint, and the third viewpoint are different from each other.

13. The image processing apparatus according to claim 5 further comprising an identification unit configured to identify the object in the image data of the real space based on the image data of the real space captured by the image capture unit,

wherein the recognition unit recognizes the posture of the object based on data related to a body of the object corresponding to an identification result obtained by the identification unit.

14. An image processing method performed by an image processing apparatus, the image processing method comprising:

recognizing, based on image data of a real space captured by an image capture unit from a predetermined viewpoint, a posture of an object in the image data of the real space;

setting a viewpoint different from the predetermined viewpoint;

generating an image of the posture of the object viewed from the set viewpoint, based on the recognized posture of the object; and

performing a display control so that the generated image of the posture of the object is displayed on a display unit.

15. An image processing method performed by an image processing apparatus, the image processing method comprising:

recognizing, based on image data of a real space captured by an image capture unit from a first viewpoint, a posture of an object in the image data of the real space;

setting a second viewpoint and a third viewpoint;

generating an image of a space in which the recognized posture of the object viewed from the second viewpoint and an image of the posture of the object viewed from the third viewpoint; and

performing a display control so that the generated image of the space and the generated image of the posture of the object are displayed on a display unit.

16. A storage medium storing a program that causes a computer to execute:

recognizing, based on image data of a real space captured by an image capture unit from a predetermined viewpoint, a posture of an object in the image data of the real space;

setting a viewpoint different from the predetermined viewpoint;

visualizing an image of the posture of the object viewed from the set viewpoint, based on the recognized posture of the object; and

performing a display control so that the generated image of the posture of the object is displayed on a display unit.

17. A storage medium storing a program that causes a computer to execute:

recognizing, based on image data of a real space captured by an image capture unit from a first viewpoint, a posture of an object in the image data of the real space;

setting a second viewpoint and a third viewpoint;

generating an image of a space in which the recognized posture of the object viewed from the second viewpoint and an image of the posture of the object viewed from the third viewpoint; and

performing a display control so that the generated image of the space and the generated image of the posture of the object are displayed on a display unit.