Image processing method and input interface apparatus

• US 8,241,122 B2
• Filed: 04/23/2007
• Issued: 08/14/2012
• Est. Priority Date: 07/07/2006
• Status: Active Grant

• Current Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Ohba, Akio, Segawa, Hiroyuki, Suzuki, Akira, Saito, Katsu, Kake, Tomokazu, Kohno, Michinari
• Primary Examiner(s): Such, Matthew W
• Assistant Examiner(s): Harriston, William
• Application Number:
  US12/307,390
• Publication Number:
  US 20090203440A1
• Time in Patent Office: 1,940 Days
• Field of Search: 345/63, 345/77, 345/214, 345/690, 463/30, 463/31, 463/32
• US Class Current: 463/32
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/254 involving subtraction of images

Abstract

For an input interface apparatus for recognizing the motion of an object, there may be cases where the brightness of the object to be captured is insufficient, and thus, a camera takes an image of the object operated by the object, a depth position detector detects the position of the object based on captured frames, an action identifying unit identifies an action of the player based on a result on the detection of the object, an input receiving unit receives the action as an instruction to an input-receiving image displayed on a display, and in response to the action, an illumination control unit raises the brightness of the image projected on the display higher than that before the action is detected.

Claims

1. An image processing method, comprising:

capturing an image of an object operated by a player,

detecting a three-dimensional position of the object based on a captured frame,

identifying an action of the player based on a result of detecting the object,

receiving the action as an instruction to an input-receiving image displayed on a display,

determining whether or not a brightness measured in the playing environment for a user is under a predetermined reference value, and

in case that the brightness measured in the playing environment of the user is under the predetermined reference value, raising, in response to the action, the brightness of the image projected on the display higher than that before the action is detected.

2. An input interface apparatus, comprising:

a camera which captures an image of an object operated by a player;

a position detector which detects the three-dimensional position of an object based on a captured frame;

an action identifying unit which identifies an action of the player based on a result of detecting the object;

an input receiving unit which receives the action as an instruction to an input-receiving image displayed on a display;

a determining unit which determines whether or not a brightness measured in the playing environment for a user is under a predetermined reference value;

an illumination control unit which, in case that the brightness measured in the playing environment of the user is under the predetermined reference value, raises, in response to the action, the brightness of the image projected on the display higher than that before the action is detected; and

a reflector which is positioned such that a reflected image of the object is projected to the camera and which causes the camera to capture the reflected image of the object together with a direct image thereof, wherein a plurality of entry regions are provided by the reflector and the brightness of the image is changed in accordance with which of the entry regions the object is positioned.

3. An input interface apparatus according to claim 2, wherein the illumination control unit raises the brightness of the image by displaying a lighting region with a higher lightness or brightness than that of the captured frame on the display.

4. An input interface apparatus according to claim 3, wherein the illumination control unit uses a part of the whole image excluding an input image for receiving an input instruction in accordance with the motion of the object, as the lighting region.

5. An input interface apparatus according to claim 3, wherein the illumination control unit uses a part of the whole image excluding the image of player captured together with the object, as the lighting region.

6. An input interface apparatus according to claim 3, further comprising an image analyzing unit which estimates the brightness of a space to be captured,

wherein when the brightness of the object is determined to be insufficient, the illumination control unit raises the brightness of the lighting region to accurately detect the object.

7. An input interface apparatus according to claim 6, wherein a parameter of the lighting region is adjusted based on the brightness of a space to be captured.

8. An input interface apparatus according to claim 3, wherein the illumination control unit causes a lighting region contained in a right half of the display and that contained in a left half thereof to be displayed alternately on the display,

the apparatus further comprising a distance estimating unit which estimates a distance of the object in the space to be captured from the display, by acquiring frames captured when either the right lighting region or left lighting region is displayed on the display by the illumination control unit and by detecting the difference between the acquired frames.

9. An input interface apparatus according to claim 3, wherein the illumination control unit causes a plurality of lighting regions of different colors to be sequentially displayed on the display,

the apparatus further comprising a color analyzing unit which acquires frames captured respectively when lighting regions of different colors are displayed on the display by the illumination control unit and, based on the variation of colors among the acquired frames, acquires color information on the object in the space to be captured.

10. An input interface apparatus according to claim 2, wherein the illumination control unit raises the brightness of the image by displaying a lighting region with a higher lightness than that of the captured frame on the display.

11. An input interface apparatus according to claim 4, wherein the illumination control unit uses a part of the whole image excluding the image of player captured together with the object, as the lighting region.

12. An input interface apparatus according to claim 4, further comprising an image analyzing unit which estimates the brightness of a space to be captured,

wherein when the brightness of the object is determined to be insufficient, the illumination control unit raises the brightness of the lighting region to accurately detect the object.

13. An input interface apparatus according to claim 5, further comprising an image analyzing unit which estimates the brightness of a space to be captured,

wherein when the brightness of the object is determined to be insufficient, the illumination control unit raises the brightness of the lighting region to accurately detect the object.

14. An input interface apparatus according to claim 4, wherein the illumination control unit causes a lighting region contained in a right half of the display and that contained in a left half thereof to be displayed alternately on the display,

the apparatus further comprising a distance estimating unit which estimates a distance of the object in the space to be captured from the display, by acquiring frames captured when either the right lighting region or left lighting region is displayed on the display by the illumination control unit and by detecting the difference between the acquired frames.

15. An input interface apparatus according to claim 5, wherein the illumination control unit causes a lighting region contained in a right half of the display and that contained in a left half thereof to be displayed alternately on the display,

the apparatus further comprising a distance estimating unit which estimates a distance of the object in the space to be captured from the display, by acquiring frames captured when either the right lighting region or left lighting region is displayed on the display by the illumination control unit and by detecting the difference between the acquired frames.

16. An input interface apparatus according to claim 4, wherein the illumination control unit causes a plurality of lighting regions of different colors to be sequentially displayed on the display,

the apparatus further comprising a color analyzing unit which acquires frames captured respectively when lighting regions of different colors are displayed on the display by the illumination control unit and, based on the variation of colors among the acquired frames, acquires color information on the object in the space to be captured.

17. An input interface apparatus according to claim 5, wherein the illumination control unit causes a plurality of lighting regions of different colors to be sequentially displayed on the display,

the apparatus further comprising a color analyzing unit which acquires frames captured respectively when lighting regions of different colors are displayed on the display by the illumination control unit and, based on the variation of colors among the acquired frames, acquires color information on the object in the space to be captured.

18. An input interface apparatus according to claim 12, wherein a parameter of the lighting region is adjusted based on the brightness of a space to be captured.

19. An input interface apparatus according to claim 13, wherein a parameter of the lighting region is adjusted based on the brightness of a space to be captured.