Information processing device and information processing method

• US 9,921,052 B2
• Filed: 09/19/2014
• Issued: 03/20/2018
• Est. Priority Date: 11/01/2013
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Ikenoue, Shoichi
• Primary Examiner(s): KALAPODAS, DRAMOS
• Application Number:
  US14/491,064
• Publication Number:
  US 20150124084A1
• Time in Patent Office: 1,278 Days
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/422 automatically for the purpose of assisting the player, e.g. automatic braking in a driving game
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: G01B 11/14 for measuring distance or clearance between spaced objects or spaced apertures G01B11/26 takes precedence; rangefinders G01C3/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/225 based on a marking or identifier characterising the area
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An information processing device includes an image acquirer that acquires a shot image of an object having a marker, a marker detector that detects an image of the marker from the shot image, and an information processing section that executes information processing based on a detection result by the marker detector. The marker detector identifies the image of the marker among color regions that are extracted from the shot image and have predetermined colors based on the positional relationship between a region that is assumed when one color region of the color regions extracted is a marker and is covered by an image of an object having the marker and another color region extracted.

Claims

1. An information processing device comprising:

an image acquirer configured to acquire a shot image of a plurality of input devices,

wherein each input devices has a marker comprising a light source, and wherein each marker has a predetermined same shape and a different color assigned to the light source by the information processing device prior to detection of the marker by the information processing device;

a marker detector configured to detect an image of each of the markers from the shot image; and

an information processing section configured to execute information processing based on a detection result by the marker detector,

wherein the marker detector identifies the image of each of the markers by;

for each of the different known colors of the markers,

extracting one or more regions from the shot image having each color;

sorting the extracted regions, for each of the different colors of the markers, in decreasing order of area;

eliminating any extracted regions not having the predetermined same shape; and

identifying the image of each of the markers using a remaining largest region of each of the different known colors.

2. The information processing device according to claim 1, wherein the marker detector acquires a distance of each input device from a camera using a relative size of the images of the markers.

3. The information processing device according to claim 1, wherein the marker detector further eliminates any extracted regions not located within a predetermined distance of a detected body part of a person holding the input device in the shot image.

4. The information processing device according to claim 2, wherein the marker detector acquires distance of a person who is holding each input device from the camera and estimates the distance of the input device held by the person using the acquired distance of the person.

5. An information processing method comprising:

acquiring, by an information processing device a shot image of an input device having a marker from a camera,

storing the shot image in a memory,

wherein the marker has a known shape and a known color assigned to the marker by the information processing device, and

wherein the marker comprises a light source;

detecting an image of the marker from the shot image read out from the memory; and

executing information processing based on a detection result,

wherein the detection of an image of the marker includes;

extracting all regions in the shot image having the known color;

sorting the extracted region in decreasing order of area;

eliminating any extracted regions not having the predetermined same shape; and

identifying the image of the marker using a remaining largest region.

6. A non-transitory computer-readable recording medium in which a computer program is recorded, the computer program for a computer including:

acquiring a shot image of an input device having a marker,

wherein the marker comprises a light source,

and storing the shot image in a memory

wherein the marker has a known shape and a color which is assigned to the light source by the computer;

detecting an image of the marker from the shot image read out from the memory; and

executing information processing based on a detection result,

wherein the detection of an image of the marker includes;

extracting all regions in the shot image having the known color;

sorting the extracted region in decreasing order of area;

eliminating any extracted regions not having the predetermined same shape; and

identifying the image of the marker using a remaining largest region.

7. A non-transitory computer-readable recording medium in which a computer program is recorded, the computer program for a computer including:

acquiring a shot image of an input device having a marker and storing the shot image in a memory

wherein the marker has a known shape and a known color;

detecting an image of the marker from the shot image read out from the memory; and

executing information processing based on a detection result,

wherein the detection of an image of the marker includes;

extracting all regions in the shot image having the known color;

sorting the extracted region in decreasing order of area;

eliminating any extracted regions not having a) the predetermined same shape and b) completely surrounded by a region of black pixels; and

identifying the image of the marker using a remaining largest region.