METHOD AND SYSTEM FOR RESPONDING TO USER'S SELECTION GESTURE OF OBJECT DISPLAYED IN THREE DIMENSIONS

• US 20140317576A1
• Filed: 12/06/2011
• Published: 10/23/2014
• Est. Priority Date: 12/06/2011
• Status: Abandoned Application

• Current Assignee: Thomson Licensing Dtv
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Song, Jianping, Du, Lin, Song, Wenjuan
• Application Number:
  US14/362,182
• Publication Number:
  US 20140317576A1
• Time in Patent Office: Days
• US Class Current: 715/852
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

The present invention relates to a method for responding to a users selection gesture of an object displayed in three dimensions. The method comprises comprising displaying at least one object using a display, detecting a users selection gesture captured using an image capturing device, and based on the image capturing devices output, determining whether an object among said at least one objects is selected by said user as a function of the eye position of the user and of the distance between the users gesture and the display.

Claims

1-10. -10. (canceled)

11. A method for responding to a user'"'"'s gesture to an object in three dimensions, wherein at least one object is displayed on a display device, the method including:

detecting a gesture of a user'"'"'s hand captured using an image capturing device;

calculating 3D coordinates of the position of the gesture and the user'"'"'s eyes;

calculating 3D coordinates of positions of the at least one object as a function of the positions of the user'"'"'s eyes;

calculating a distance of the position of the gesture to the image capturing device, a distance of the position of the gesture to the each object, and a size of the each object;

calculating a probability value to respond to the gesture for each accessible object using the distance of the position of the gesture to the image capture device, the distance of the position of the gesture to the each object, and the size of the each object;

selecting one object with the greatest probability value; and

responding to the gesture of the one object.

12. The method according to claim 11, wherein the image capture device comprises of two cameras aligned horizontally and having the same focal length.

13. The method according to claim 12, wherein the 3D coordinates are calculated on the basis of 2D coordinates of left and right images of the selection gesture, the focal length of the cameras, and a distance between the cameras.

14. The method according to claim 13, wherein 3D coordinates of positions of the object are calculated on the basis of 3D coordinates of the positions of the user'"'"'s right and left eyes and 3D coordinates of the object in right and left views.

15. A system for responding to a user'"'"'s gesture to an object in three dimensions, wherein at least one object is displayed on a display device, the system comprising a processor configured to implement:

detecting a gesture of a user'"'"'s hand captured using an image capturing device;

calculating 3D coordinates of the position of the gesture and the user'"'"'s eyes;

calculating a distance of the position of the gesture to the image capturing device, a distance of the position of the gesture to the each object, and a size of the each object;

calculating a probability value to respond to the gesture for each accessible object using the distance of the position of the gesture to the image capture device, the distance of the position of the gesture to the each object, and the size of the each object;

selecting one object with the greatest probability value; and

responding to the gesture of the one object.

16. The system according to claim 15, wherein the image capture device comprises of two cameras aligned horizontally and having the same focal length.

17. The system according to claim 16, wherein the 3D coordinates are calculated on the basis of 2D coordinates of left and right images of the selection gesture, the focal length of the cameras, and a distance between the cameras.