METHOD AND APPARATUS FOR SELECTING OBJECT

• US 20140337740A1
• Filed: 05/07/2014
• Published: 11/13/2014
• Est. Priority Date: 05/07/2013
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: KWON, Sung-hyuk, KIM, Jae-yeop, LEE, Jin-ha, NAOURJEAN, Christophe
• Application Number:
  US14/271,875
• Publication Number:
  US 20140337740A1
• Time in Patent Office: Days
• US Class Current: 715/728
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

Provided herein is a method for selecting an object. The method for selecting an object according to an exemplary embodiment includes displaying a plurality of objects on a screen, recognizing a voice uttered by a user and tracking an eye of the user with respect to the screen, and selecting at least one object from among the plurality of objects on the screen based on the recognized user'"'"'s voice and the tracked eye.

Claims

1. A method for selecting an object, the method comprising:

displaying a plurality of objects on a screen;

recognizing a voice uttered by a user;

tracking an eye of the user with respect to the screen; and

selecting at least one object from among the plurality of objects on the screen based on the recognized voice and the tracked eye.

2. The method according to claim 1, wherein the selecting comprises:

identifying the at least one object matching the recognized voice from among the plurality of objects on the screen; and

selecting the at least one object in response to the at least one object being located in an area on the screen matching the tracked eye.

3. The method according to claim 1, wherein the selecting comprises:

searching for at least one text matching the recognized voice and displaying the at least one text in an area on the screen; and

selecting at least one text located in the area on the screen matching the tracked eye from among the at least one displayed text.

4. The method according to claim 1, wherein the selecting comprises:

displaying, on the screen, at least one object having tag information matching the recognized voice; and

selecting the at least one object in response to the at least one object being located in an area on the screen matching the tracked eye.

5. The method according to claim 1, wherein the selecting comprises:

selecting an area on the screen matching the tracked eye; and

selecting the at least one object matching the recognized voice in the selected area on the screen.

6. The method according to claim 1, wherein the selecting comprises:

displaying the at least one object on an area of the screen matching the tracked eye; and

selecting an object matching the recognized voice from among the at least one displayed object.

7. The method according to claim 1, wherein the selecting comprises:

displaying the at least one object on an area of the screen matching the tracked eye; and

selecting at least one object having tag information matching the recognized voice from among the at least one displayed object.

8. The method according to claim 1,

wherein the displaying comprises:

tracking a movement of the eye with respect to the screen; and

scrolling the screen along a direction in which the eye moved in response to a determination that the tracked eye has deviated from the screen, and

wherein the selecting comprises selecting at least one object matching the recognized voice from among the at least one object displayed on an area of the screen corresponding to a track along which the eye moved.

9. The method according to claim 1, further comprising:

sensing and recognizing a movement of the user; and

selecting at least one object from among the at least one object selected based on the recognized voice, the tracked eye, and the recognized movement.

10. The method according to claim 1, wherein the object is at least one of an application icon, a content icon, a thumbnail image, a folder icon, a widget, a list item, a hyperlink, a text, a flash object, a menu, and a content image.

11. An apparatus for selecting an object, the apparatus comprising:

a displayer configured to display a plurality of objects on a screen;

an eye tracker configured to track an eye of a user with respect to the screen;

a voice recognizer configured to recognize a voice uttered by the user; and

a controller configured to select at least one object from among the plurality of objects on the screen based on the recognized voice and the tracked eye.

12. The apparatus according to claim 11,

wherein the controller identifies at least one object matching the recognized voice from among the plurality of objects on the screen, and selects the at least one object in response to the at least one object being located in an area on the screen matching the tracked eye.

13. The apparatus according to claim 11,

wherein the controller searches for at least one text matching the recognized voice and displays the at least one text in an area on the screen, and selects at least one text located in the area on the screen matching tracked eye from among the at least one displayed text

14. The apparatus according to claim 11,

wherein the controller displays, on the screen, at least one object having tag information matching the recognized voice, and selects the at least one object in response to the at least one object being located in an area on the screen matching the tracked eye.

15. The apparatus according to claim 11,

wherein the controller selects an area on the screen matching the tracked eye, and selects the at least one object matching the recognized voice in the selected area on the screen.

16. The apparatus according to claim 11,

wherein the controller displays the at least one object on the area of the screen matching the tracked eye, and selects an object matching the recognized voice from among the at least one displayed object.

17. The apparatus according to claim 11,

wherein the controller displays the at least one object on an area of the screen matching the tracked eye, and selects at least one object having tag information matching the recognized voice from among the at least one displayed object.

18. The apparatus according to claim 11, wherein the controller:

tracks a movement of the eye with respect to the screen, and scrolls the screen along a direction in which the eye moved in response to a determination that the tracked eye has deviated from the screen, and

selects at least one object matching the recognized voice from among the at least one object displayed on the area of the screen corresponding to a track along which the eye moved.

19. The apparatus according to claim 11, further comprising:

a motion sensor configured to sense and recognize a movement of the user,

wherein the controller selects at least one object from among the at least one object selected based on the recognized voice, the tracked eye, and the recognized movement.

20. The apparatus according to claim 11, wherein the object is at least one of an application icon, a content icon, a thumbnail image, a folder icon, a widget, a list item, a hyperlink, a text, a flash object, a menu, and a content image.

21. A method of on-screen selection, the method comprising:

receiving voice information relating to a screen and a gaze area on the screen, wherein the gaze area is based on an eye position and eye movement of a user; and

determining a selection of an object on the screen based on the gaze area and the voice information.