Image processing apparatus and method, and program therefor

• US 8,896,535 B2
• Filed: 02/26/2013
• Issued: 11/25/2014
• Est. Priority Date: 09/19/2007
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tsurumi, Shingo, Doi, Shouichi
• Primary Examiner(s): PATEL, PREMAL R
• Application Number:
  US13/777,823
• Publication Number:
  US 20130169537A1
• Time in Patent Office: 637 Days
• Field of Search: 345156-158, 715/768, 715/810, 348/699, 348/734
• US Class Current: 345/158
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

An image processing apparatus includes an extracting unit for extracting a feature point from a captured image; a recognizing unit for recognizing a position of the feature point; a display unit for displaying, based on the position of the feature point, a feature-point pointer indicating the feature point and a mirrored image of the captured image in a translucent manner; and an issuing unit for issuing, based on the position of the feature point, a command corresponding to the position of the feature point or a motion of the feature point.

Claims

1. An image processing apparatus comprising:

circuitry configured to

extract a feature point from a captured image,

recognize a position of the feature point,

concurrently display, based on the position of the feature point, a feature-point pointer indicating the feature point, a plurality of user interfaces arranged as a ring surrounding the feature-point pointer, a mirrored image, and a content image associated with a program channel,

issue, based on the position of the feature point, a command corresponding to the position of the feature point or a motion of the feature point relative to at least one of the user interfaces surrounding the feature-point pointer, and

cause a change in the content image in response to the command,

wherein the mirrored image corresponds with a translucent, horizontally flipped version of the captured image, and

the plurality of user interfaces are removed from display in response to a dragging of the feature-point pointer outside of the ring.

2. The image processing apparatus of claim 1, wherein the circuitry displays, the mirrored image overlaid on the content image.

3. The image processing apparatus of claim 2, wherein the ring along which the plurality of user interfaces are arranged is a circle centered on the feature-point pointer.

4. The image processing apparatus of claim 3, wherein the circuitry is further configured to recognize a grab gesture, wherein a volume of space is enclosed within a user'"'"'s palm forming the grab gesture, the volume of space corresponding to a volume of space surrounding the feature-point pointer.

5. The image processing apparatus of claim 4, wherein the circuitry:

issues the command corresponding to a selected one of the plurality of user interfaces after a representation of the recognized grab gesture and the feature-point pointer are superimposed on the selected user interface.

6. The image processing apparatus of claim 1,

wherein the circuitry extracts a plurality of feature points from the captured image, and

wherein the circuitry issues, for each of the plurality of feature points, based on a position of the feature point, a command corresponding to the position of the feature point or to a motion of the feature point.

7. The image processing apparatus according to claim 6,

wherein the circuitry displays, for each of the plurality of feature points, based on a position of the feature point, a feature-point pointer indicating the feature point and predetermined user interfaces, and

wherein the circuitry issues, for each of the feature points, based on a position of the feature point, a command corresponding to one of the plurality of user interfaces.

8. The image processing apparatus according to claim 6,

wherein the circuitry displays, for each of the plurality of feature points, based on a position of the feature point, a feature-point pointer indicating the feature point, and a set of predetermined user interfaces that are shared by the plurality of feature points, and

wherein the circuitry issues, for each of the plurality of feature points, based on a position of the feature point, a command corresponding to one of user interfaces in the set of predetermined user interfaces.

9. The image processing apparatus according to claim 1,

wherein the circuitry extracts a plurality of feature points from the captured image, and

wherein the circuitry issues commands corresponding to positions or motions of the plurality of feature points.

10. An image processing method comprising:

extracting a feature point from a captured image;

recognizing a position of the feature point;

concurrently displaying, based on the position of the feature point, a feature-point pointer indicating the feature point, a plurality of user interfaces arranged as a ring surrounding the feature-point pointer, a mirrored image, and a content image associated with a program channel;

issuing, based on the position of the feature point, a command corresponding to the position of the feature point or a motion of the feature point relative to at least one of the user interfaces surrounding the feature-point pointer; and

causing a change in the content image in response to the command,

wherein the mirrored image corresponds with a translucent, horizontally flipped version of the captured image, and

the plurality of user interfaces are removed from display in response to a dragging of the feature-point pointer outside of the ring.

11. The image processing method of claim 10, wherein the displaying step additionally comprises displaying the mirrored image overlaid on the content image.

12. The image processing method of claim 11, wherein the ring along which the plurality of user interfaces are arranged is a circle centered on the feature-point pointer.

13. The image processing method of claim 12, further comprising:

recognizing a grab gesture, wherein a volume of space is enclosed within a user'"'"'s palm performing the grab gesture, the volume of space corresponding to a volume of space surrounding the feature-point pointer.

14. The image processing method of claim 13, wherein:

the issuing step comprising issuing the command corresponding to a selected one of the plurality of user interfaces after a representation of the recognized grab gesture and the feature-point pointer are superimposed on the selected user interface.

15. A non-transitory computer-readable medium comprising program code, the program code being operable, when executed by a computer system, to cause the computer system to perform steps comprising:

extracting a feature point from a captured image;

recognizing a position of the feature point;

concurrently displaying, based on the position of the feature point, a feature-point pointer indicating the feature point, a plurality of user interfaces arranged as a ring surrounding the feature-point pointer, a mirrored image, and a content image associated with a program channel;

issuing, based on the position of the feature point, a command corresponding to the position of the feature point or a motion of the feature point relative to at least one of the user interfaces surrounding the feature-point pointer; and

causing a change in the content image in response to the command,

wherein the mirrored image corresponds with a translucent, horizontally flipped version of the captured image, and

the plurality of user interfaces are removed from display in response to a dragging of the feature-point pointer outside of the ring.

16. The non-transitory computer-readable medium of claim 15, wherein the displaying step further comprises displaying the mirrored image overlaid on the content image.

17. The computer-readable medium of claim 16, wherein the ring along which plurality of user interfaces are arranged is a circle centered on the feature-point pointer.

18. An image processing apparatus comprising:

extracting means for extracting a feature point from a captured image;

recognizing means for recognizing a position of the feature point;

display means for concurrently displaying, based on the position of the feature point, a feature-point pointer indicating the feature point, a plurality of user interfaces arranged as a ring surrounding the feature-point pointer, a mirrored image, and a content image associated with a program channel;

issuing means for issuing, based on the position of the feature point, a command corresponding to the position of the feature point or a motion of the feature point relative to at least one of the user interfaces surrounding the feature-point pointer; and

means for causing a change in the content image in response to the command,

wherein the mirrored image corresponds with a translucent, horizontally flipped version of the captured image, and

the plurality of user interfaces are removed from display in response to a dragging of the feature-point pointer outside of the ring.

19. The image processing apparatus of claim 18, wherein the display means additionally displays the mirrored image overlaid on the content image.

20. The image processing apparatus of claim 19, wherein the ring along which a plurality of predetermined user interfaces are arranged is a circle centered on the feature-point pointer.