Image processing device that analyzes motion of object

• US 9,466,110 B2
• Filed: 03/18/2013
• Issued: 10/11/2016
• Est. Priority Date: 03/21/2012
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Ishige, Yoshiki
• Primary Examiner(s): Liew, Alex
• Application Number:
  US13/846,857
• Publication Number:
  US 20130251200A1
• Time in Patent Office: 1,303 Days
• Field of Search: 382/103
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30221 Sports video; Sports image
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06T 7/38 Registration of image sequences
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

In an image processing device (1), the motion detection unit (43) extracts an outline indicating a body from an image of each frame in moving image data of a player and sets a motion reference axis(line) to each part of the body. Then, the motion comparison unit (44) compares a moving image of the player and a moving image of a professional golfer based on a motion of a main motion reference axis(line) and generates moving image data for comparison to which comparison result data is added. Based on this moving image data for comparison, the comparison result display control unit (45) distinguishably displays a difference between the moving image of the player and the moving image of the professional golfer.

Claims

1. An image processing device comprising:

a processor configured to;

acquire a first group of images and a second group of images in which motion of a first object and motion of a second object are captured, respectively;

detect a difference between a posture of the first object and a posture of the second object as a difference between the motion of the first object and the motion of the second object; and

perform control to display, on a display, the first group of images and the second group of images such that a difference between a first speed of motion of the first object and a second speed of motion of the second object is adjusted for displaying on the display, based on the difference between the motion of the first object and the motion of the second object, in a case in which the processor detects the difference between the posture of the first object and the posture of the second object,

wherein the processor is configured to perform control to display, on the display, an index indicating a direction or a magnitude of the difference between the motion of the first object in the first group of images and the motion of the second object in the second group of images.

2. The image processing device according to claim 1, wherein the processor is configured to adjust the difference between the first speed of motion of the first object and the second speed of motion of the second object by thinning out one of the first group of images and the second group of images corresponding to a slower one of the first speed of motion of the first object and the second speed of motion of the second object.

3. The image processing device according to claim 1, wherein the processor is configured to adjust the difference between the first speed of motion of the first object and the second speed of motion of the second object by interpolating one of the first group of images and the second group of images corresponding to a faster one of the first speed of motion of the first object and the second speed of motion of the second object.

4. The image processing device according to claim 1, wherein the is configured to perform control to display, on the display, the first group of images and the second group of images such that one of the first group of images and the second group of images is more noticeable than the other of the first group of images and the second group of images, frames of the one of the first group of images and the second group of images being a target to be adjusted for displaying.

5. The image processing device according to claim 1, wherein the processor is configured to set, on the first group of images, a first line which is a reference of motion of the first object, and detect posture of the first object is different from the posture of the second object by comparing the first line and a second line which is set on the second group of images.

6. The image processing device according to claim 1, wherein the processor is configured to extract an outline of the first object and the second object, and set the first line and the second line based on an edge point and a bending point of the outlines extracted by the outline extracting unit.

7. The image processing device according to claim 1, wherein the processor is configured to perform control to display, on the display, information corresponding to a detecting the difference between the posture of the first object and the posture of the second object.

10. The image processing device according to claim 1, wherein the processor is configured to adjust the difference between the first speed of motion of the first object and the second speed of motion of the second object for displaying on the display to correct the difference between the motion of the first object and the motion of the second object.

11. The image processing device according to claim 6, wherein the processor is configured to detect a difference between the first line and the second line;

and

wherein the processor is configured to perform control to display, on the display, the first group of images and the second group of images such that the difference between the first speed of motion of the first object and the second speed of motion of the second object is adjusted for displaying on the display, based on the difference between the first line and the second line, in a case in which the processor detects the difference between the posture of the first object and the posture of the second object.

12. The image processing device according to claim 11, wherein the processor is configured to adjust the difference between the first speed of motion of the first object and the second speed of motion of the second object for displaying on the display to correct the difference between the first line and the second line.

13. The image processing device according to claim 1,

wherein the processor is configured to detect a difference between a timing of motion of the first object and a timing of motion of the second object as the difference between the motion of the first object and the motion of the second object, and

wherein the processor is configured to adjust the difference between the first speed of motion of the first object and the second speed of motion of the second object for displaying on the display based on the difference between the timing of motion of the first object and the timing of motion of the second object.

14. The image processing device according to claim 1, wherein the motion of the first object and the motion of the second object include a motion of a golf swing.

15. The image processing device according to claim 1, wherein the processor is configured to:

determine whether the first speed of motion of the first object is different from the second speed of motion of the second object; and

perform control to display on a display, the first group of images and the second group of images such that the difference between the first speed of motion of the first object and the second speed of motion of the second object is adjusted for displaying on the display, based on the difference between the motion of the first object and the motion of the second object, in a case in which the processor determines that the first speed of motion of the first object is different from the second speed of motion of the second object.

16. The image processing device according to claim 1, wherein the processor is configured to detect the difference between the posture of the first object and the posture of the second object as the difference between the motion of the first object and the motion of the second object at each frame among the first group of images and the second group of images.

17. The image processing device according to claim 16, wherein the processor is configured to detect the difference between the posture of the first object and the posture of the second object as a difference in motion timing between the motion of the first object and the motion of the second object at each frame among the first group of images and the second group of images.

8. An image processing method for an image processing device, the method comprising:

acquiring a first group of images and a second group of images in which motion of a first object and motion of a second object are captured, respectively;

detecting a difference between a posture of the first object and a posture of the second object as a difference between the motion of the first object and the motion of the second object; and

performing control to display, on a display, the first group of images and the second group of images such that a difference between a first speed of motion of the first object and a second speed of motion of the second object is adjusted for displaying on the display, based on the difference between the motion of the first object and the motion of the second object, in a case in which the difference between the posture of the first object and the posture of the second object is detected,

wherein detecting the difference comprises setting, on the first group of images, a first line which is a reference of motion of the first object, and detecting whether the posture of the first object is different from the posture of the second object by comparing the first line and a second line which is set on the second group of images.

9. A non-transitory computer-readable medium having stored thereon a program that is executable by a computer of an image processing device, the program being executable by the computer to cause the computer to perform functions comprising:

acquiring a first group of images and a second group of images in which motion of a first object and motion of a second object are captured, respectively;

detecting a difference between a posture of the first object and a posture of the second object as a difference between the motion of the first object and the motion of the second object;

performing control to display, on a display, the first group of images and the second group of images such that a difference between a first speed of motion of the first object and a second speed of motion of the second object is adjusted for displaying on the display, based on the difference between the motion of the first object and the motion of the second object, in a case in which the difference between the posture of the first object and the posture of the second object is detected; and

performing control to display, on the display, an index indicating a direction or a magnitude of the difference between the motion of the first object in the first group of images and the motion of the second object in the second group of images.

18. An image processing device comprising:

a processor which is configured to;

acquire a first group of images and a second group of images in which motion of a first object and motion of a second object are captured, respectively;

set, on the first group of images, a first line which is a reference of motion of the first object;

detect a difference between the motion of the first object and the motion of the second object by comparing the first line and a second line which is set on the second group of images; and

perform control to display, on a display, the first group of images and the second group of images such that a difference between a first speed of motion of the first object and a second speed of motion of the second object is adjusted for displaying on the display, in a case in which the processor detects the difference between the motion of the first object and the motion of the second object.

19. The image processing device according to claim 18, wherein the processor is configured to:

determine whether a first speed of motion of the first object is different from a second speed of motion of the second object; and

perform control to display, on the display, the first group of images and the second group of images such that the difference between the first speed of motion of the first object and the second speed of motion of the second object is adjusted for displaying on the display based on the difference between the motion of the first object and the motion of the second object, in a case in which the processor determines that the first speed of motion of the first object is different from the second speed of motion of the second object.

20. An image processing method for an image processing device, the method comprising:

acquiring a first group of images and a second group of images in which motion of a first object and motion of a second object are captured, respectively;

detecting a difference between motion of the first object and motion of the second object;

performing control to display, on a display, the first group of images and the second group of images such that a difference between the first speed of motion of the first object and the second speed of motion of the second object is adjusted for displaying on the display, based on the difference between the motion of the first object and the motion of the second object, in a case in which it is detected that the difference between motion of the first object and motion of the second object; and

performing control to display, on the display, an index indicating a direction or a magnitude of the difference between the motion of the first object in the first group of images and the motion of the second object in the second group of images.