Information processing apparatus and method, input device and method, program, and information processing system

• US 7,692,630 B2
• Filed: 12/08/2005
• Issued: 04/06/2010
• Est. Priority Date: 12/14/2004
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Natsume, Tetsu, Rekimoto, Junichi, Ayatsuka, Yuji
• Primary Examiner(s): Wu; Xiao M
• Assistant Examiner(s): Welch; David T
• Application Number:
  US11/296,226
• Publication Number:
  US 20060150113A1
• Time in Patent Office: 1,580 Days
• Field of Search: 345/420, 345/158, 235/462.11, 273/237, 273/284, 463/36, 463/37, 463/11
• US Class Current: 345/158
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/833 Hand-to-hand fighting, e.g. martial arts competition A63F13/837 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06K 19/06037 multi-dimensional coding
• CPC Class Codes: G06K 7/10722 Photodetector array or CCD scanning
• CPC Class Codes: G09G 5/08 Cursor circuits

Abstract

An information processing apparatus includes the following elements. An image data acquisition unit acquires image data of a captured image including a code having a fixed area in which a predetermined fixed area code is formed and a variable area in which a variable area code formed by a combination of a plurality of codes is formed. A fixed area code recognition unit analyzes the captured image to recognize the predetermined fixed area code of the fixed area. A variable area code default value setting unit sets the default value of the variable area code based on the predetermined fixed area code. A variable area code recognition unit analyzes the captured image to recognize the variable area code. A comparator compares the variable area code with the default value to determine the difference therebetween. A command designation unit designates a command to be executed based on the difference.

Claims

1. An information processing apparatus for reading a code included in an image, comprising:

image data acquisition means for acquiring, via a camera, image data of a control card having a 2D code printed thereon, the 2D code printed on the control card having a first area containing a fixed area in which a predetermined fixed area code is formed, a second area containing a guide portion, and a third area containing a variable area in which a variable area code formed by a combination of a plurality of codes is formed, the plurality of codes created by concealment or unconcealment of cells in the variable area;

fixed area code recognition means for analyzing the acquired image data to recognize the predetermined fixed area code of the fixed area;

variable area code default value setting means for setting a default value of the variable area code based on the predetermined fixed area code;

variable area code recognition means for analyzing the acquired image data to recognize the variable area code;

comparison means for comparing the recognized variable area code with the default value to determine a difference between the variable area code and the default value; and

command designation means for designating a command to be executed based on the obtained difference.

2. The information processing apparatus according to claim 1, wherein the value of the entire variable area code formed in the variable area is set to be the default value, and the variable area code is changed by concealing part of or the entirety of the variable area code.

3. The information processing apparatus according to claim 1, wherein a state in which no variable area code is formed in the variable area is set to be the default value, and the variable area code is changed by adding a code to the variable area.

4. The information processing apparatus according to claim 1, further comprising code table storage means for storing a code table, which is table information for associating the fixed area code with the default value,

wherein the variable area code default value setting means sets the default value corresponding to the fixed area code by referring to the code table stored in the code table storage means.

5. The information processing apparatus according to claim 1, further comprising command table storage means for storing a command table, which is table information for associating the difference with the command,

wherein the command designation means designates the command corresponding to the difference by referring to the command table stored in the command table storage means.

6. The information processing apparatus according to claim 1, wherein the guide portion is a basis for specifying a position of the fixed area and a position of the variable area included in the code.

7. An information processing method for an information processing apparatus for reading a code included in an image, comprising the steps of:

executing, by a processor, the steps of;

acquiring, via a camera, image data of a control card having a 2D code printed thereon, the 2D code printed on the control card having a first area containing a fixed area in which a predetermined fixed area code is formed, a second area containing a guide portion, and a third area containing a variable area in which a variable area code formed by a combination of a plurality of codes is formed, the plurality of codes created by concealment or unconcealment of cells in the variable area;

recognizing the predetermined fixed area code of the fixed area by analyzing the acquired image data;

setting a default value of the variable area code based on the recognized predetermined fixed area code;

recognizing the variable area code by analyzing the acquired image data;

comparing the recognized variable area code with the set default value to determine a difference between the variable area code and the default value; and

designating a command to be executed based on the determined difference.

8. A computer-readable storage medium storing a computer-readable program which, when executed by a processor, performs a method of processing for reading a code included in an image, the method comprising the steps of:

acquiring, via a camera, image data of a control card having a 2D code printed thereon, the 2D code printed on the control card having a first area containing a fixed area in which a predetermined fixed area code is formed, a second area containing a guide portion, and a third area containing a variable area in which a variable area code formed by a combination of a plurality of codes is formed, the plurality of codes created by concealment or unconcealment of cells in the variable area;

recognizing the predetermined fixed area code of the fixed area by analyzing the acquired image data;

setting a default value of the variable area code based on the recognized predetermined fixed area code;

recognizing the variable area code by analyzing the acquired image data;

comparing the recognized variable area code with the set default value to determine a difference between the variable area code and the default value; and

designating a command to be executed based on the determined difference.

9. An information processing system comprising:

an information processing apparatus for reading a 2D code printed on a control card; and

an input device for inputting information into the information processing apparatus according to the 2D code,

wherein the information processing apparatus includes

image data acquisition means for acquiring, via a camera, image data of the control card having a 2D code printed thereon, the 2D code printed on the control card having a first area containing a fixed area in which a predetermined fixed area code is formed, a second area containing a guide portion, and a third area containing a variable area in which a variable area code formed by a combination of a plurality of codes is formed, the plurality of codes created by concealment or unconcealment of cells in the variable area;

fixed area code recognition means for analyzing the acquired image data to recognize the predetermined fixed area code of the fixed area;

variable area code default value setting means for setting a default value of the variable area code based on the predetermined fixed area code;

variable area code recognition means for analyzing the acquired image data to recognize the variable area code;

comparison means for comparing the recognized variable area code with the default value to determine a difference between the variable area code and the default value; and

command designation means for designating a command to be executed based on the obtained difference, and

the input device includes

operation receiving means for receiving an operation performed on the 2D code by a user and showing the 2D code which is changed by the received operation to an imaging portion of the information processing apparatus, thereby inputting information corresponding to the operation into the information processing apparatus.

10. An information processing apparatus for reading a code included in an image, comprising:

an image data acquisition unit configured to acquire, via a camera, image data of a control card having a 2D code printed thereon, the 2D code printed on the control card having a first area containing a fixed area in which a predetermined fixed area code is formed, a second area containing a guide portion, and a third area containing a variable area in which a variable area code formed by a combination of a plurality of codes is formed, the plurality of codes created by concealment or unconcealment of cells in the variable area;

a fixed area code recognition unit configured to analyze the acquired image data to recognize the predetermined fixed area code of the fixed area;

a variable area code default value setting unit configured to set a default value of the variable area code based on the predetermined fixed area code;

a variable area code recognition unit configured to analyze the acquired image data to recognize the variable area code;

a comparator configured to compare the recognized variable area code with the default value to determine a difference between the variable area code and the default value; and

a command designation unit configured to designate a command to be executed based on the obtained difference.

11. An information processing system comprising:

an information processing apparatus for reading a 2D code printed on a control card; and

an input device for inputting information into the information processing apparatus according to the 2D code,

wherein the information processing apparatus includes

an image data acquisition unit configured to acquire, via a camera, image data of a control card having a 2D code printed thereon, the 2D code printed on the control card having a first area containing a fixed area in which a predetermined fixed area code is formed, a second area containing a guide portion, and a third area containing a variable area in which a variable area code formed by a combination of a plurality of codes is formed, the plurality of codes created by concealment or unconcealment of cells in the variable area;

a fixed area code recognition unit configured to analyze the acquired image data to recognize the predetermined fixed area code of the fixed area;

a variable area code default value setting unit configured to set a default value of the variable area code based on the predetermined fixed area code;

a variable area code recognition unit configured to analyze the acquired image data to recognize the variable area code;

a comparator configured to compare the recognized variable area code with the default value to determine a difference between the variable area code and the default value; and

a command designation unit configured to designate a command to be executed based on the obtained difference, and

the input device includes

an operation receiver configured to receive an operation performed on the 2D code by a user and showing the 2D code which is changed by the received operation to an imaging portion of the information processing apparatus, thereby inputting information corresponding to the operation into the information processing apparatus.