Information processing apparatus, method of displaying movement recognizable standby state, method of showing recognizable movement, method of displaying movement recognizing process, and program storage medium

• US 7,046,232 B2
• Filed: 04/19/2001
• Issued: 05/16/2006
• Est. Priority Date: 04/21/2000
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yamaguchi, Yoshihiro, Ihara, Keigo, Gomi, Shinichiro, Inagaki, Takeo, Sueyoshi, Takahiko, Saito, Junko
• Primary Examiner(s): CHANG, KENT WU
• Application Number:
  US09/838,644
• Publication Number:
  US 20020006222A1
• Time in Patent Office: 1,853 Days
• Field of Search: 345/157, 345/158, 715705-710, 715/859, 715/861, 348/333.02
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

The information processing apparatus allows, based on an image obtained by photographing a user by the CCD camera 8, to recognize the movement direction of the user and when generating a command corresponding to the recognized movement direction, to create the gesture recognition screen 100 in a search state indicating that the apparatus is searching for the user'"'"'s movement and display it on a liquid crystal display 10 so as to certainly notify the user that the user'"'"'s movement is recognizable and it is in a standby state. Further, the information processing apparatus allows, before recognizing the movement direction of the user'"'"'s action based on the image obtained by photographing the user by the CCD camera 8, to generate a gesture recognition screen 100 in advance for making the user visualize a recognizable movement direction and display a target division 107 arranged in a horizontal line on the gesture recognition screen 100 so as to notify the user in advance that right-and-left movement is recognizable, using the target division 107. Furthermore, the information processing apparatus allows, based on the image obtained by photographing the user'"'"'s hand with the CCD camera 8, to recognize the movement direction of the hand in the image and generate a visual feedback screen representing the trail of the movement of the recognized hand and display it on the liquid crystal display 10 so as to make the user learn on how the movement of the hand was recognized, by feedback.

Claims

1. An information processing apparatus, comprising:

a movement trail recognizing unit configured to, based on an image obtained by photographing a recognition subject by an image pickup unit, recognize the movement trail of said recognition subject;

a control unit configured to generate a predetermined recognizable movement direction image picture in advance for making a user visualize said recognizable movement direction and displaying it on a predetermined display unit; and

a transformation unit, configured to transform said movement trail recognized by said movement trail recognizing unit to correspond with said displayed predetermined recognizable movement direction.

2. The information processing apparatus according to claim 1, wherein said control unit notifies said user, by displaying as said recognizable movement direction image picture a plurality of marks of a predetermined shape sequentially arranged in a predetermined direction on said display unit, that said movement trail unit can recognize the movement direction of said recognition subject in said predetermined direction.

3. The information processing apparatus according to claim 2, wherein said control unit colors said marks of a predetermined shape in a different color from that of a background image on said display unit.

6. The information processing apparatus according to claim 1, wherein the control unit is configured to, while not recognizing the movement trail of said recognition subject, generating a predetermined standby state image indicating that said movement trail recognizing unit is searching for said recognition subject in said image and displaying the standby state image on the predetermined display unit.

7. The information processing apparatus according to claim 6, wherein said control unit alternately displays, as said standby state image, a plurality of marks of a predetermined shape sequentially arranged in a predetermined direction, in said direction and in a reverse direction thereof in order.

4. A method of showing a recognizable movement comprising:

a movement trail recognizing step of, based on an image obtained by photographing a recognition subject by an image pickup unit, recognizing the movement trail of said recognition subject;

an image generation processing step of, generating a predetermined recognizable movement trail image picture in advance for making a user visualize said recognizable movement direction which can be recognized by said movement direction recognizing processing step;

a display processing step of displaying said recognizable movement direction image picture generated by said image generation processing step in predetermined display means;

transforming said movement trail recognized by said movement trail recognizing step to correspond with said displayed predetermined recognizable movement direction.

5. A program storage medium causing an information processing apparatus to execute a program, wherein said program comprises:

a movement trail recognizing processing step of, based on an image obtained by photographing a recognition subject by an image pickup unit, recognizing the movement trail of said recognition subject;

an image generation processing step of, generating a predetermined recognizable movement direction image picture in advance for making a user visualize said movement recognizable direction which can be recognized by said movement direction recognizing processing step; and

a display processing step of displaying said recognizable movement direction image picture generated by said image generation processing step on a predetermined display unit; and

transforming said movement trail recognized by said movement trial recognizing step to correspond with said displayed predetermined recognizable movement direction.