Display device, display method, and program

• US 9,411,418 B2
• Filed: 06/03/2013
• Issued: 08/09/2016
• Est. Priority Date: 06/22/2012
• Status: Active Grant

• Current Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Original Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Inventors: Shiraishi, Seiji, Sugisaki, Haruhiko, Yamazaki, Hitoshi, Suzuki, Daisuke
• Primary Examiner(s): Patel, Sanjiv D
• Application Number:
  US14/405,883
• Publication Number:
  US 20150185833A1
• Time in Patent Office: 1,163 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Information-processing device detects a visual line of a user, and displays cursor at the position viewed by the user. If the user touches a display area of an image using his/her finger while cursor is close to an edge of the display area, the position touched by the finger is recorded. When the user moves the finger, a scrolling speed is determined according to a distance the finger is moved and the image is scrolled in the direction of cursor. In a case where the position viewed by the user and a scrolling direction change, and where a line of a scrolling direction before the change crosses a line of a scrolling direction after the change, the scrolling direction changes while the scrolling speed is maintained.

Claims

1. A display device, comprising:

a display unit having a display surface on which an image is displayed;

a first detecting unit that detects a visual line of a user;

a second detecting unit that detects an operation performed by the user on the display surface;

a direction determining unit that determines a scrolling direction of the image according to the visual line detected by the first detecting unit;

a speed determining unit that determines a scrolling speed of the image according to the operation detected by the second detecting unit; and

a display control unit that controls the display unit to scroll the image in the scrolling direction, when the visual line moves from a place outside of a predetermined area of the display unit to a location within the predetermined area, the image commences scrolling at the scrolling speed, wherein the scrolling speed is maintained when the visual line is moved from the predetermined area to the place outside of the predetermined area, and when the visual line moves from a first position within the predetermined area to a second position such that a movement to the second position is in an opposite direction as the scrolling direction, the image scrolling is stopped or scrolled at a predetermined speed, and when the scrolling speed changes as a result of an input operation by the user, the image is scrolled at a second scrolling speed according to the input operation.

2. The display device according to claim 1, wherein the display control unit, when the visual line moves from the first position within the predetermined area to the second position such that a movement to the second position is in an opposite direction as the scrolling direction the image starts to scroll at a third scrolling speed, the third scrolling speed being faster than the scrolling speed before the visual line in the predetermined area was moved.

3. A display method, comprising the steps of:

detecting a visual line of a user;

detecting an operation performed by the user on a display surface of a display unit that displays an image;

determining a scrolling direction of the image according to the detected visual line;

determining a scrolling speed of the image according to the detected operation; and

controlling the display unit to scroll the image in the scrolling direction, when the visual line moves from a place outside of a predetermined area of the display unit to a location within the predetermined area, the image commences scrolling at the scrolling speed, wherein the scrolling speed is maintained when the visual line is moved from the predetermined area to the place outside of the predetermined area, and when the visual line moves from a first position within the predetermined area to a second position such that a movement to the second position is in an opposite direction as the scrolling direction, the image scrolling is stopped or scrolled at a predetermined speed, and when the scrolling speed changes as a result of an input operation by the user, the image is scrolled at a second scrolling speed according to the input operation.

4. A program stored on a non-transitory computer readable medium for causing a computer to execute the steps of:

detecting a visual line of a user;

detecting an operation performed by the user on a display surface of a display unit that displays an image;

determining a scrolling direction of the image according to the detected visual line;

determining a scrolling speed of the image according to the detected operation; and

controlling the display unit to scroll the image in the scrolling direction, when the visual line moved from a place outside of a predetermined area of the display unit to a location within the predetermined area, the image commences scrolling at the scrolling speed, wherein the scrolling speed is maintained when the visual line is moved from the predetermined area to the place outside of the predetermined area, and when the visual line moves from a first position within the predetermined area to a second position such that a movement to the second position is in an opposite direction as the scrolling directed, the image scrolling is stopped or scrolled at a predetermined speed, and when the scrolling speed changes as a result of an input operation by the user, the image is scrolled at a second scrolling speed according to the input operation.