Image processing apparatus and method, and program therefor

• US 8,643,598 B2
• Filed: 09/16/2008
• Issued: 02/04/2014
• Est. Priority Date: 09/19/2007
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tsurumi, Shingo, Doi, Shouichi
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): PATEL, PREMAL R
• Application Number:
  US12/211,651
• Publication Number:
  US 20090073117A1
• Time in Patent Office: 1,967 Days
• Field of Search: 345156-158, 348/699, 348/734, 715/810
• US Class Current: 345/158
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

An image processing apparatus includes an extracting unit configured to extract a feature point from a captured image; a recognizing unit configured to recognize a position of the feature point; a display control unit configured to perform control, based on the position of the feature point, to display a feature-point pointer indicating the feature point; and an issuing unit configured to issue, based on the position of the feature point, a command corresponding to the position of the feature point or a motion of the feature point.

Claims

1. An image processing apparatus comprising:

extracting means for extracting a feature point from a captured image;

recognizing means for recognizing a position of the feature point;

display control means for performing control, based on the position of the feature point, to display a feature-point pointer indicating the feature point, and a plurality of predetermined user interfaces;

gesture recognizing means for recognizing a grab gesture, wherein a volume of space is enclosed within a user'"'"'s palm, the volume of space corresponding to a volume of space surrounding the feature-point pointer; and

issuing means for issuing, based on the position of the feature point, a command corresponding to the position of the feature point or a motion of the feature point,

wherein the display control means displays the plurality of predetermined user interfaces in a predetermined pattern surrounding the feature-point pointer, and

wherein the command issued by the issuing means is capable of terminating the display of the plurality of user interfaces, the termination being triggered by detection of a predetermined gesture that results in the feature-point pointer being moved from inside a circular region encompassing the plurality of user interfaces to outside said region.

2. The image processing apparatus according to claim 1,

wherein the extracting means extracts a plurality of feature points from the captured image, and

wherein the issuing means issues, for each of the feature points, based on a position of the feature point, a command corresponding to the position of the feature point or to a motion of the feature point.

3. The image processing apparatus according to claim 2,

wherein the display control means performs control, for each of the feature points, based on a position of the feature point, to display a feature-point pointer indicating the feature point and predetermined user interfaces, and

wherein the issuing means issues, for each of the feature points, based on a position of the feature point, a command corresponding to one of the user interfaces.

4. The image processing apparatus according to claim 3,

wherein the display control means performs control, for each of the feature points, based on a position of the feature point, to display a feature-point pointer indicating the feature point, and to display predetermined user interfaces, the predetermined user interfaces being shared by the plurality of feature points, and

wherein the issuing means issues, for each of the feature points, based on a position of the feature point, a command corresponding to one of the user interfaces.

5. The image processing apparatus according to claim 1,

wherein the extracting means extracts a plurality of feature points from the captured image, and

wherein the issuing means issues commands corresponding to positions or motions of the plurality of feature points.

6. An image processing method for an image processing apparatus configured to extract a feature point from a captured image, the image processing method comprising the steps of:

extracting the feature point from the captured image;

recognizing a position of the feature point;

displaying, based on the position of the feature point, a feature-point pointer indicating the feature point, and a plurality of predetermined user interfaces;

recognizing a grab gesture, wherein a volume of space is enclosed within a user'"'"'s palm, the volume of space corresponding to a volume of space surrounding the feature-point pointer; and

issuing, based on the position of the feature point, a command corresponding to the position of the feature point or to a motion of the feature point,

wherein the plurality of predetermined user interfaces are displayed in a predetermined pattern surrounding the feature-point pointer, and

wherein the command issued is capable of terminating the display of the plurality of user interfaces, the termination being triggered by detection of a predetermined gesture that results in the feature-point pointer being moved from inside a circular region encompassing the plurality of user interfaces to outside said region.

7. A program for causing a computer to execute image processing for extracting a feature point from a captured image, the image processing comprising the steps of:

extracting the feature point from the captured image;

recognizing a position of the feature point;

displaying, based on the position of the feature point, a feature-point pointer indicating the feature point, and a plurality of predetermined user interfaces;

recognizing a grab gesture, wherein a volume of space is enclosed within a user'"'"'s palm, the volume of space corresponding to a volume of space surrounding the feature-point pointer; and

issuing, based on the position of the feature point, a command corresponding to the position of the feature point or to a motion of the feature point,

wherein the plurality of predetermined user interfaces are displayed in a predetermined pattern surrounding the feature-point pointer, and

wherein the command issued is capable of terminating the display of the plurality of user interfaces, the termination being triggered by detection of a predetermined gesture that results in the feature-point pointer being moved from inside a circular region encompassing the plurality of user interfaces to outside said region.

8. An image processing apparatus comprising:

an extracting unit configured to extract a feature point from a captured image;

a recognizing unit configured to recognize a position of the feature point;

a display control unit configured to perform control, based on the position of the feature point, to display a feature-point pointer indicating the feature point, and a plurality of predetermined user interfaces;

a recognizing unit configured to recognize a grab gesture, wherein a volume of space is enclosed within a user'"'"'s palm, the volume of space corresponding to a volume of space surrounding the feature-point pointer; and

an issuing unit configured to issue, based on the position of the feature point, a command corresponding to the position of the feature point or to a motion of the feature point,

wherein the display control unit displays the plurality of predetermined user interfaces in a predetermined pattern surrounding the feature-point pointer, and

wherein the command issued by the issuing unit is capable of terminating the display of the plurality of user interfaces, the termination being triggered by detection of a predetermined gesture that results in the feature-point pointer being moved from inside a circular region encompassing the plurality of user interfaces to outside said region.