Pose detection method, video game apparatus, pose detection program, and computer-readable medium containing computer program

• US 20060046847A1
• Filed: 09/02/2005
• Published: 03/02/2006
• Est. Priority Date: 09/02/2004
• Status: Active Grant

• Current Assignee: SEGA Corporation (SEGA Sammy Holdings Inc.)
• Original Assignee: SEGA Corporation (SEGA Sammy Holdings Inc.)
• Inventors: Hashimoto, Yoshihisa
• Granted Patent: US 7,559,841 B2
• Time in Patent Office: Days
• US Class Current: 463/36
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/5375 for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1018 Calibration; Key and button assignment
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands

Abstract

A technique is disclosed for detecting a pose of a player in a video game using an input image supplied by a camera. The technique involves calculating a frame difference and/or background difference of an image of a predetermined region of an image captured by the camera which captured image includes a player image representing the pose of the player, and generating operations information corresponding to the pose of the player based on the calculated frame difference and/or background difference.

Claims

1. A pose detection method implemented in a video game using an input image supplied by a camera for detecting a pose of a player, the method comprising the steps of:

calculating a frame difference and/or background difference of an image of a predetermined region of an image captured by the camera which captured image includes a player image representing the pose of the player; and

generating operations information corresponding to the pose of the player based on the calculated frame difference and/or background difference.

2. The pose detection method as claimed in claim 1, further comprising the steps of:

calculating a left side frame difference and/or background difference of a left side image corresponding to a left side region within the captured image and a right side frame difference and/or background difference of a right side image corresponding to a right side region within the captured image;

calculating a left side center position of the left side frame difference and/or background difference and a right side center position of the right side frame difference and/or background difference;

calculating a positional difference between the left side center position and the right side center position with respect to up/down directions;

calculating an average position value of the left side center position and the right side center position with respect to the up/down directions; and

converting a value based on the calculated positional difference and the calculated average position value into an analog stick signal.

3. The pose detection method as claimed in claim 2, further comprising the steps of:

calculating a left side background difference of the left side region and a right side background difference of the right side region;

calculating an additional region background difference of an additional region other than the left side region and the right side region within the captured image; and

generating the operations information corresponding to the pose of the player based on whether the additional region background difference is substantial upon determining that the left side background difference and the right side background difference are insubstantial.

4. The pose detection method as claimed in claim 1, wherein

the captured image is displayed within a portion of a monitor screen as an operations confirmation screen.

5. The pose detection method as claimed in claim 2, further comprising a step of:

displaying at least one marker indicating a position of a hand of the player that is recognized in at least one of the left side center position and the right side center position.

6. A video game apparatus that is configured to execute a video game that uses an input image supplied by a camera, the apparatus comprising:

a frame difference/background difference calculating part for calculating a frame difference and/or background difference of an image of a predetermined region of an image captured by the camera which captured image includes a player image representing a pose of a player; and

an operations information generating part for generating operations information corresponding to the pose of the player based on the calculated frame difference and/or background difference.

7. The video game apparatus as claimed in claim 6, wherein

the frame difference/background difference calculating part is configured to calculate a left side frame difference and/or background difference of a left side image corresponding to a left side region within the captured image and a right side frame difference and/or background difference of a right side image corresponding to a right side region within the captured image, the apparatus further comprising:

a center position calculating part for calculating a left side center position of the left side frame difference and/or background difference and a right side center position of the right side frame difference and/or background difference;

a positional difference calculating part for calculating a positional difference between the left side center position and the right side center position with respect to up/down directions;

an average position value calculating part for calculating an average position value of the left side center position and the right side center position with respect to the up/down directions; and

an analog stick signal conversion part for converting a value based on the positional difference and the average position value into an analog stick signal.

8. The video game apparatus as claimed in claim 7, further comprising:

a first background difference calculating part for calculating a left side background difference of the left side region and a right side background difference of the right side region; and

a second background difference calculating part for calculating an additional region background difference of an additional region other than the left side region and the right side region within the captured image;

wherein the operations information generating part is configured to generate the operations information corresponding to the pose of the player based on whether the additional region background difference is substantial upon determining that the left side background difference and the right side background difference are insubstantial.

9. A computer-readable medium containing a pose detection program run on a computer for detecting a pose of a player in a video game using an input image supplied by a camera, the program being executed by the computer to realize the functions of:

calculating a frame difference and/or background difference of an image of a predetermined region of an image captured by the camera which captured image includes a player image representing the pose of the player; and

generating operations information corresponding to the pose of the player based on the calculated frame difference and/or background difference.

10. The computer-readable medium as claimed in claim 9, wherein the program is executed by the computer to realize the functions of:

calculating a left side frame difference and/or background difference of a left side image corresponding to a left side region within the captured image and a right side frame difference and/or background difference of a right side image corresponding to a right side region within the captured image;

calculating a left side center position of the left side frame difference and/or background difference and a right side center position of the right side frame difference and/or background difference;

calculating a positional difference between the left side center position and the right side center position with respect to up/down directions;

calculating an average position value of the left side center position and the right side center position with respect to the up/down directions; and

converting a value based on the calculated positional difference and the calculated average position value into an analog stick signal.

11. The computer-readable medium as claimed in claim 10, wherein the program is executed by the computer to realize the functions of:

calculating a left side background difference of the left side region and a right side background difference of the right side region;

calculating an additional region background difference of an additional region other than the left side region and the right side region within the captured image; and

generating the operations information corresponding to the pose of the player based on whether the additional region background difference is substantial upon determining that the left side background difference and the right side background difference are insubstantial.

12. A pose detection program run on a computer for detecting a pose of a player in a video game using an input image supplied by a camera, the program being executed by the computer to realize the functions of:

calculating a frame difference and/or background difference of an image of a predetermined region of an image captured by the camera which captured image includes a player image representing the pose of the player; and

generating operations information corresponding to the pose of the player based on the calculated frame difference and/or background difference.

13. The pose detection program as claimed in claim 12, further being executed by the computer to realize the functions of:

calculating a left side frame difference and/or background difference of a left side image corresponding to a left side region within the captured image and a right side frame difference and/or background difference of a right side image corresponding to a right side region within the captured image;

calculating a left side center position of the left side frame difference and/or background difference and a right side center position of the right side frame difference and/or background difference;

calculating a positional difference between the left side center position and the right side center position with respect to up/down directions;

calculating an average position value of the left side center position and the right side center position with respect to the up/down directions; and

converting a value based on the calculated positional difference and the calculated average position value into an analog stick signal.

14. The pose detection program as claimed in claim 13, further being executed by the computer to realize the functions of:

calculating a left side background difference of the left side region and a right side background difference of the right side region;

calculating an additional region background difference of an additional region other than the left side region and the right side region within the captured image; and

generating the operations information corresponding to the pose of the player based on whether the additional region background difference is substantial upon determining that the left side background difference and the right side background difference are insubstantial.