METHOD AND APPARATUS FOR CONTROLLING DISPLAY OF REGION IN MOBILE DEVICE

• US 20150077381A1
• Filed: 09/19/2013
• Published: 03/19/2015
• Est. Priority Date: 09/19/2013
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Park, Min-Kyu, Kim, Kang, Lee, Minsub
• Application Number:
  US14/031,885
• Publication Number:
  US 20150077381A1
• Time in Patent Office: Days
• US Class Current: 345/174
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

According to an aspect of the present disclosure, a method for controlling display of a region on a touch screen display of a mobile device is disclosed. The method includes receiving a command indicative of zooming by a first sensor, sensing at least one image including at least one eye by a camera, determining a direction of a gaze of the at least one eye based on the at least one image, determining a target region to be zoomed on the touch screen display based on the direction of the gaze, and zooming the target region on the touch screen display.

Claims

1. A method for controlling display of a region on a touch screen display of a mobile device, the method comprising:

receiving, by a first sensor, a command indicative of zooming;

sensing, by a camera, at least one image including at least one eye;

determining a direction of a gaze of the at least one eye based on the at least one image;

determining a target region to be zoomed on the touch screen display based on the direction of the gaze, wherein the touch screen display includes a touch screen sensor; and

zooming the target region on the touch screen display.

2. The method of claim 1, wherein determining the target region to be zoomed comprises:

identifying an object on the touch screen display indicated by the direction of the gaze; and

determining the target region to include the identified object.

3. The method of claim 1, wherein zooming the target region comprises displaying the target region on a different region of the touch screen display.

4. The method of claim 1, wherein receiving the command by the first sensor comprises receiving, by a pressure sensor, a pressure input indicative of the command.

5. The method of claim 1, wherein receiving the command by the first sensor comprises capturing, by a microphone, a voice input indicative of the command.

6. The method of claim 1, wherein receiving the command by the first sensor comprises detecting, by an accelerometer, a predetermined motion of the mobile device indicative of the command.

7. The method of claim 1, wherein receiving the command by the first sensor comprises detecting, by a gyroscope, a predetermined motion of the mobile device indicative of the command.

8. The method of claim 1, wherein receiving the command by the first sensor comprises detecting, by a touch sensor, a touch input indicative of the command, the touch sensor being disposed on a portion of the mobile device other than the touch screen display.

9. The method of claim 8, wherein the portion is a back portion of the mobile device.

10. The method of claim 1, wherein the first sensor is a multimodal sensor including at least two of a pressure sensor, a microphone, an accelerometer, a gyroscope, a touch sensor, and a proximity sensor.

11. A method for controlling display of a region on a touch screen display of a mobile device, the method comprising:

displaying a first screen on the touch screen display including a touch screen sensor;

receiving, by a first sensor, a command to display a target region of the first screen at a different region in the touch screen display; and

displaying a second screen including the target region at the different region in the touch screen display.

12. The method of claim 11, wherein displaying the second screen including the target region comprises zooming the target region at the different region in the touch screen display.

13. The method of claim 11, wherein receiving the command to display the target region of the first screen comprises:

sensing, by a camera, at least one image including at least one eye;

determining a direction of a gaze of the at least one eye based on the at least one image; and

determining the target region of the first screen based on the direction of the gaze.

14. The method of claim 11, wherein receiving the command by the first sensor comprises receiving, by a pressure sensor, a pressure input indicative of the command

15. The method of claim 11, wherein receiving the command by the first sensor comprises capturing, by a microphone, a voice input indicative of the command.

16. The method of claim 11, wherein receiving the command by the first sensor comprises detecting, by an accelerometer, a predetermined motion of the mobile device indicative of the command.

17. The method of claim 11, wherein receiving the command by the first sensor comprises detecting, by a touch sensor, a touch input indicative of the command, the touch sensor being disposed on a portion of the mobile device other than the touch screen display.

18. The method of claim 11, wherein the first sensor is a proximity sensor configured to sense a proximate contact with at least one portion of the touch screen display as the command.

19. The method of claim 18, wherein the touch screen sensor includes the proximity sensor.

20. The method of claim 11, wherein the first sensor is a multimodal sensor including at least two of a pressure sensor, a microphone, an accelerometer, a gyroscope, a touch sensor, and a proximity sensor.

21. A mobile device for controlling display of a region in the mobile device, the mobile device comprising:

a first sensor configured to receive an input indicative of a command to zoom;

a command recognition unit configured to recognize the command to zoom based on the input;

a camera configured to sense at least one image including at least one eye;

a gaze detection unit configured to determine a direction of a gaze of the at least one eye based on the at least one image;

a touch screen display having a touch screen sensor; and

a display controller configured to determine a target region to be zoomed on the touch screen display based on the direction of the gaze and zoom the target region on the touch screen display.

22. The mobile device of claim 21, wherein the display controller is further configured to:

identify an object on the touch screen display indicated by the direction of the gaze; and

determine the target region to include the identified object.

23. The mobile device of claim 21, wherein the display controller is further configured to display the target region on a different region of the touch screen display.

24. The mobile device of claim 21, wherein the first sensor includes a pressure sensor configured to receive a pressure input indicative of the command.

25. The mobile device of claim 21, wherein the first sensor includes a microphone configured to capture a voice input indicative of the command.

26. The mobile device of claim 21, wherein the first sensor includes an accelerometer configured to detect a predetermined motion of the mobile device indicative of the command.

27. The mobile device of claim 21, wherein the first sensor includes a gyroscope configured to detect a predetermined motion of the mobile device indicative of the command

28. The mobile device of claim 21, wherein the first sensor includes a touch sensor configured to detect a touch input indicative of the command, the touch sensor being disposed on a portion of the mobile device other than the touch screen display.

29. The mobile device of claim 28, wherein the portion is a back portion of the mobile device.

30. The mobile device of claim 21, wherein the first sensor is a multimodal sensor including at least two of a pressure sensor, a microphone, an accelerometer, a gyroscope, a touch sensor, and a proximity sensor.

31. A mobile device for controlling display of a region on a touch screen display of the mobile device, the mobile device comprising:

means for receiving, by a first sensor, a command indicative of zooming;

means for sensing, by a camera, at least one image including at least one eye;

means for determining a direction of a gaze of the at least one eye based on the at least one image;

means for determining a target region to be zoomed on the touch screen display based on the direction of the gaze, wherein the touch screen display includes a touch screen sensor; and

means for zooming the target region on the touch screen display.

32. The mobile device of claim 31, wherein the means for determining the target region is configured to:

identify an object on the touch screen display indicated by the direction of the gaze; and

determine the target region to include the identified object.

33. The mobile device of claim 31, wherein the means for zooming the target region is configured to display the target region on a different region of the touch screen display.

34. The mobile device of claim 31, wherein the first sensor includes a pressure sensor configured to receive a pressure input indicative of the command.

35. The mobile device of claim 31, wherein the first sensor includes a microphone configured to capture a voice input indicative of the command

36. The mobile device of claim 31, wherein the first sensor includes an accelerometer configured to detect a predetermined motion of the mobile device indicative of the command.

37. The mobile device of claim 31, wherein the first sensor includes a gyroscope configured to detect a predetermined motion of the mobile device indicative of the command

38. The mobile device of claim 31, wherein the first sensor includes a touch sensor configured to detect a touch input indicative of the command, the touch sensor being disposed on a portion of the mobile device other than the touch screen display.

39. The mobile device of claim 38, wherein the portion is a back portion of the mobile device.

40. The mobile device of claim 31, wherein the first sensor is a multimodal sensor including at least two of a pressure sensor, a microphone, an accelerometer, a gyroscope, a touch sensor, and a proximity sensor.

41. A non-transitory computer-readable storage medium comprising instructions for controlling display of a region on a touch screen display of a mobile device, the instructions causing a processor of the mobile device to perform the operations of:

receiving, by a first sensor, a command indicative of zooming;

sensing, by a camera, at least one image including at least one eye;

determining a direction of a gaze of the at least one eye based on the at least one image;

determining a target region to be zoomed on the touch screen display based on the direction of the gaze, wherein the touch screen display includes a touch screen sensor; and

zooming the target region on the touch screen display.

42. The storage medium of claim 41, wherein determining the target region to be zoomed comprises:

identifying an object on the touch screen display indicated by the direction of the gaze; and

determining the target region to include the identified object.

43. The storage medium of claim 41, wherein zooming the target region comprises displaying the target region on a different region of the touch screen display.

44. The storage medium of claim 41, wherein receiving the command by the first sensor comprises receiving, by a pressure sensor, a pressure input indicative of the command

45. The storage medium of claim 41, wherein receiving the command by the first sensor comprises capturing, by a microphone, a voice input indicative of the command.

46. The storage medium of claim 41, wherein receiving the command by the first sensor comprises detecting, by an accelerometer, a predetermined motion of the mobile device indicative of the command.

47. The storage medium of claim 41, wherein receiving the command by the first sensor comprises detecting, by a gyroscope, a predetermined motion of the mobile device indicative of the command.

48. The storage medium of claim 41, wherein receiving the command by the first sensor comprises detecting, by a touch sensor, a touch input indicative of the command, the touch sensor being disposed on a portion of the mobile device other than the touch screen display.

49. The storage medium of claim 48, wherein the portion is a back portion of the mobile device.

50. The storage medium of claim 41, wherein the first sensor is a multimodal sensor including at least two of a pressure sensor, a microphone, an accelerometer, a gyroscope, a touch sensor, and a proximity sensor.