GUI SYSTEM, DISPLAY PROCESSING DEVICE, AND INPUT PROCESSING DEVICE

• US 20150199111A1
• Filed: 01/14/2015
• Published: 07/16/2015
• Est. Priority Date: 01/16/2014
• Status: Abandoned Application

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: OKADA, Takeshi
• Application Number:
  US14/596,868
• Publication Number:
  US 20150199111A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

A GUI system includes a display processing device that has a display unit, a first processing unit configured to cause the display unit to display a screen including an icon, and a gaze direction detection unit configured to detect a gaze direction of a user, and an input processing device that has a second processing unit capable of communicating with the first processing unit, the second processing unit being configured to identify an operation, and an operation transmission unit configured to transmit the operation identified by the second processing unit to the first processing unit. The first processing unit controls the display processing device based on a location identified by the gaze direction detection unit and the operation transmitted by the operation transmission unit.

Claims

1. A GUI system comprising:

a display processing device including

a display unit,

a first processing unit configured to cause the display unit to display a screen including an icon, and

a gaze direction detection unit configured to detect a gaze direction of a user, and

an input processing device including

a second processing unit capable of communicating with the first processing unit, the second processing unit being configured to identify an operation, and

an operation transmission unit configured to transmit the operation identified by the second processing unit to the first processing unit, wherein

the first processing unit controls the display processing device based on a location identified by the gaze direction detection unit and the operation transmitted by the operation transmission unit.

2. The GUI system according to claim 1, wherein

the first processing unit selects the icon when the location identified by the gaze direction detection unit is the location of the icon in the screen, and

the first processing unit determines the selection of the icon selected by a selection unit, based on the operation transmitted by the operation transmission unit.

3. The GUI system according to claim 2, wherein the first processing unit includes a display mode change unit configured to change the display mode of the icon when the location identified by the gaze direction detection unit is the location of the icon.

4. The GUI system according to claim 2, wherein the first processing unit moves the selected icon in the screen, based on the operation transmitted by the operation transmission unit.

5. The GUI system according to claim 1, wherein the first processing unit further includes a scroll unit configured to scroll the screen in a direction in which the location identified by the gaze direction detection unit is off a central area in the screen when the location identified by the gaze direction detection unit is an area outside the central area in the screen and the operation transmitted by the operation transmission unit is received.

6. The GUI system according to claim 1, wherein the first processing unit displays information associated with a specific point on the screen when the location identified by the gaze direction detection unit is the specific point in the screen and a contact command transmitted by the operation transmission unit is received.

7. The GUI system according to claim 1, wherein

the second processing unit includes a switch unit configured to switch between an input mode in which to identify an operation to the display processing device performed on a touch panel and some other mode, and

the second processing unit identifies an operation on the touch panel based on an output signal from the touch panel when the operation on the touch panel is performed in the input mode.

8. The GUI system according to claim 1, wherein

the input processing device further comprises a touch panel,

the second processing unit identifies an operation on the touch panel based on an output signal from the touch panel, and

the operation transmission unit transmits the operation on the touch panel identified by the second processing unit to the first processing unit.

9. A display processing device comprising:

a display unit;

a processing unit configured to cause the display unit to display a screen including an icon;

a gaze direction detection unit configured to detect a gaze direction of a user, thereby identifying a location in the screen displayed on the display unit; and

a reception unit configured to receive the content of an operation from an input processing device capable of communicating with the processing unit, wherein

the processing unit controls the display processing device based on the location identified by the gaze direction detection unit and the content of the operation received by the reception unit.

10. The display processing device according to claim 9, wherein

the processing unit selects the icon when the location identified by the gaze direction detection unit is the location of the icon in the screen, and

the processing unit determines the selection of the selected icon, based on an operation transmitted by an operation transmission unit.

11. The display processing device according to claim 10, wherein the processing unit changes the display mode of the icon when the location identified by the gaze direction detection unit is the location of the icon in the screen.

12. The display processing device according to claim 9, wherein the processing unit moves the selected icon in the screen, based on the content of the operation received by the reception unit.

13. The display processing device according to claim 9, wherein the processing unit scrolls the screen in a direction in which the location identified by the gaze direction detection unit is off a central area in the screen when the location identified by the gaze direction detection unit is an area outside the central area in the screen and the operation transmitted by an operation transmission unit is received.

14. The display processing device according to claim 9, wherein the processing unit displays information associated with a specific point on the screen when the location identified by the gaze direction detection unit is the specific point in the screen and a contact command transmitted by a transmission unit is received.

15. An input processing device comprising:

an operation unit;

a connection unit configured to connect to a display processing device by communication;

an identification unit configured to identify an operation of the operation unit based on an output signal from the touch panel;

an operation transmission unit configured to transmit the operation on the touch panel identified by the identification unit to the display processing device connected via the connection unit; and

a switch unit configured to switch between an input mode in which to identify an operation to the display processing device performed by the operation unit and some other mode, wherein

the identification unit identifies an operation based on an output signal from the touch panel when the operation of the operation unit is performed in the input mode.