Pose detection method, video game apparatus, pose detection program, and computer-readable medium containing computer program

• US 7,559,841 B2
• Filed: 09/02/2005
• Issued: 07/14/2009
• Est. Priority Date: 09/02/2004
• Status: Expired due to Fees

• Current Assignee: SEGA Corporation (SEGA Sammy Holdings Inc.)
• Original Assignee: SEGA Corporation (SEGA Sammy Holdings Inc.)
• Inventors: Hashimoto, Yoshihisa
• Primary Examiner(s): Hotaling, II; John M.
• Assistant Examiner(s): D'Agostino; Paul Anthony
• Application Number:
  US11/219,378
• Publication Number:
  US 20060046847A1
• Time in Patent Office: 1,411 Days
• Field of Search: 273/454, 463/4, 463/36, 463/37, 382/106, 382/103
• US Class Current: 463/36
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/5375 for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1018 Calibration; Key and button assignment
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands

Abstract

A technique is disclosed for detecting a pose of a player in a video game using an input image supplied by a camera. The technique involves calculating a frame difference and/or background difference of an image of a predetermined region of an image captured by the camera which captured image includes a player image representing the pose of the player, and generating operations information corresponding to the pose of the player based on the calculated frame difference and/or background difference.

Claims

1. A pose detection method implemented in a video game using an input image supplied by a camera for detecting a pose of a player, the method comprising the steps of:

calculating a left side frame difference background difference a left side image corresponding to a left side region of an image captured by the camera which captured image includes a player image representing the pose of the player and a right side frame difference or background difference of a right side image corresponding to a right side region of the captured image;

calculating a left side center position of the left side frame difference or background difference and a right side center position of the right side frame difference or background difference;

calculating a positional difference between the left side center position and the right side center position with respect to up and down directions;

calculating an average position value of the left side center position and the right side center position with respect to up and down directions; and

generating operations information corresponding to the pose of the player based on the calculated positional difference and calculated average position values,

converting a value based on the calculated positional difference and the calculated average position value into an analog stick signal,

calculating an additional region background difference of an additional region other than the left side region and the right side region within the captured image; and

generating the operations information corresponding to the pose of the player based on whether the additional region background difference is substantial upon determining that the left side background difference and the right side background difference are insubstantial.

2. The pose detection method as claimed in claim 1, wherein the captured image is displayed within a portion of a monitor screen as an operations confirmation screen.

3. The pose detection method as claimed in claim 1, further comprising a step of:

displaying at least one marker indicating a position of a hand of the player that is recognized in at least one of the left side center position and the right side center position.

4. A video game apparatus having a CPU with the apparatus configured to execute a video game that uses an input image supplied by a camera, the apparatus comprising:

a left side frame difference or background calculating part for calculating a left side frame difference or background difference of an image corresponding to a left side region of an image captured by the camera which captured image includes a player image representing a pose of a player and a right side frame difference background difference calculating part for calculating a right side image corresponding to a right side region within the captured image, the apparatus further comprising;

a center position calculating part for calculating a left side center position of the left side frame difference or background difference and a right side center position of the right side frame difference or background difference;

a positional difference calculating part for calculating a positional difference between the left side center position and the right side center position with respect to up and down directions;

an average position value calculating part for calculating an average position value of the left side center position and the right side center position with respect to the and down directions;

an operations information generating part for generating operations information corresponding to the pose of the player based on the calculated positional difference and calculated average position value,

an analog stick signal conversion part for converting a value based on the positional difference and the average position value into an analog stick signal,

a first background difference calculating part for calculating a left side background difference of the left side region and a right side background difference of the right side region; and

a second background difference calculating part for calculating an additional region background difference of an additional region other than the left side region and the right side region within the capture image;

wherein the operations information generating part is configured to generate the operations information corresponding to the pose of the player based on whether the additional region background difference is substantial upon determining that the left side background difference and the right side background difference are insubstantial.

5. A computer-readable medium defining a physical storage device for use with a computer containing a pose detection program run on the computer for detecting a pose of a player in a video game using an input image supplied by a camera, the program being executed by the computer to realize the functions of:

calculating a left side frame difference or background difference of a left side image corresponding to a left side region of an image captured by the camera which captured image includes a player image representing the pose of the player and a right side frame difference or background difference of a right side image corresponding to a right side region of the captured image;

calculating a left side center position of the left side frame difference or background difference and a right side center position of the right side frame difference or background difference;

calculating a positional difference between the left side center position and the right side center position with respect to up and down directions;

calculating an average position value of the left side center position and the right side center position with respect to the up and down directions; and

generating operations information corresponding to the pose of the player based on the calculated frame positional difference and background difference calculated average position value.

6. The computer-readable medium as claimed in claim 5, wherein the program is executed by the computer to realize the functions of:

calculating a left side frame difference or background difference of a left side image corresponding to a left side region within the captured image and a right side frame difference or background difference of a right side image corresponding to a right side region within the captured image;

calculating a left side center position of the left side frame difference or background difference and a right side center position of the right side frame difference or background difference;

calculating a positional difference between the left side center position and the right side center position with respect to up and down directions;

calculating an average position value of the left side center position and the right side center position with respect to the up and down directions;

converting a value based on the calculated positional difference and the calculated average position value into an analog stick signal, and

calculating a left side background difference on the left side region and a right side background difference of the right side region;

calculating an additional region background difference of an additional region other than the left side region and the right side region within the captured image; and

generating the operations information corresponding to the pose of the player based on whether the additional region background difference is substantial upon determining that the left side background difference and the right side background difference are insubstantial.

7. A computer having a pose detection program for detecting a pose of a player represented on an input image supplied by a camera, with the program being executed by the computer to realize the functions of:

calculating a left side frame difference or background difference of a left side image corresponding to a left side region of an image captured by the camera which captured image includes a player image representing the pose of the player and a right side frame difference or background difference of a right side image corresponding to a right side region of the captured image;

calculating a left side center position of the left side frame difference or background difference and a right side center position of the right side frame difference or background difference;

calculating a positional difference between the left side center position and the right side center position with respect to up and down directions;

calculating an average position value of the left side center position and the right side center position with respect to the up and down directions; and

generating operations information corresponding to the pose of the player based on the calculated positional difference and calculated average position value.

8. The computer as claimed in claim 7, wherein the pose detection program is further executed to realize the functions of:

calculating a left side frame difference or background difference of a left side image corresponding to a left side region within the captured image and a right side frame difference or background difference of a right side image corresponding to a right side region within the captured image;

calculating a left side center position of the left side frame difference or background difference and a right side center position of the right side frame difference or background difference;

calculating a positional difference between the left side center position and the right side center position with respect to up and down directions;

calculating an average position value of the left side center position and the right side center position with respect to the up and down directions;

converting a value based on the calculated positional difference and the calculated average position value into an analog stick signal and

wherein the pose detection program is further executed to realize the functions of;

calculating a left side background difference of the left side region and a right side background difference of the right side region;

calculating an additional region background difference of an additional region other than the left side region and the right side region within the captured image; and

generating the operations information corresponding to the pose of the player based on whether the additional region background difference is substantial upon determining that the left side background difference and the right side background difference are insubstantial.