INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND COMPUTER PROGRAM

• US 20130271368A1
• Filed: 12/16/2011
• Published: 10/17/2013
• Est. Priority Date: 12/20/2010
• Status: Abandoned Application

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Shiroshima, Takahiro
• Application Number:
  US13/995,541
• Publication Number:
  US 20130271368A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Provided is an information processing device capable of executing a larger variety of processes on screen data on the basis of motion of the device body.

An information processing device 1 has: a display unit 11 provided with a display screen; a contact detection unit 12 which detects contacting operation to the display screen and a position of the contact; a motion detection unit 13 which detects information representing a motion of the own device; an operation mode selection unit 14 which, while the contact position detected by the contact detection unit 12 is kept included in any one of one or more operation areas defined in the display screen, selects a predetermined operation mode related to the operation area; a display process discrimination unit 15 which discriminates the content of a display process designated with respect to screen data displayed on the display screen, on the basis of a combination of the operation mode and information representing a motion of the own device; and a display process control unit 16 which, if information representing a motion of the own device is detected by the motion detection unit 13 while the operation mode is kept selected, executes a display process discriminated by the display process discrimination unit 15 on screen data.

Claims

1. :

An information processing device comprising;

a display unit provided with a display screen for displaying data;

a contact detection unit which detects a contacting operation to said display screen and contact position of the operation;

a motion detection unit which detects information representing a motion of its own device (the information processing device it belongs to);

an operation mode selection unit which, while said contact position detected by said contact detection unit is kept included in any one of one or more operation areas defined in advance within the area of said display screen, keeps selecting a predetermined operation mode related to the operation area;

a display process discrimination unit which discriminates a content of a display process designated with respect to screen data displayed on said display screen, on the basis of a combination of said operation mode and said information representing a motion of the own device; and

a display process control unit which executes the display process discriminated by said display process discrimination unit on said screen data if said information representing a motion of the own device is detected by said motion detection unit while said operation mode is kept selected by said operation mode selection unit.

2. :

The information processing device according to claim 1, wherein;

said information processing device is connected to another information processing device displaying approximately the same screen data as said screen data, and further comprising;

a display process information sending unit which sends display process information representing the content of a display process executed by said display process control unit to said another information processing device, and

a display process information receiving unit which receives said display process information from said another information processing devices; and

said display process control unit further executes a process represented by the display process information received by said display process information receiving unit on said screen data.

3. :

The information processing device according to claims 1 further comprising

a starting process information storage unit which stores said operation mode and starting process information representing a process determined in advance to be executed when selection of the operation mode is started, in a manner to relate them to each other, wherein;

said starting process information storage unit stores a content of a preliminary process necessary for executing said display process, by including the content into said starting process information; and

when said operation mode selection unit has started keeping said operation mode selected, said display process control unit executes a process represented by said starting process information related to the selected operation mode.

4. :

The information processing device according to any one of claims 1 further comprising

a during-operation-mode process information storage unit which stores said operation mode and during-operation-mode process information representing a process determined in advance to be executed every time said display process is discriminated by said display process discrimination unit while the operation mode is kept selected, in a manner to relate them to each other, wherein;

said during-operation-mode process information storage unit stores process content constituting said display process, by including the process content into said during-operation-mode process information; and

every time said display process is discriminated by said display process discrimination unit while said operation mode is kept selected by said operation mode selection unit, said display process control unit executes a process represented by said during-operation-mode process information related to the selected operation mode.

5. :

The information processing device according to any one of claims 1 further comprising

an ending process information storage unit which stores said operation mode and ending process information representing a process determined in advance to be executed when selection of the operation mode has been stopped, in a manner to relate them to each other, wherein;

said ending process information storage unit stores process content constituting said display process, by including the process content into said ending process information; and

when said operation mode selection unit has stopped keeping said operation mode selected, said display process control unit executes a process represented by said ending process information related to the operation mode having been kept selected.

6. :

The information processing device according to claim 3, wherein;

said starting process information storage unit stores the content of a sending process which sends information representing said preliminary process included in said starting process information to said another information processing device, by further including the content into the starting process information; and

when said operation mode selection unit has started keeping said operation mode selected, said display process information sending unit further executes said sending process included in said starting process information related to the selected operation mode.

7. :

The information processing device according to claim 4, wherein;

said during-operation-mode process information storage unit stores the content of a sending process which sends said process content included in said during-operation-mode process information to said another information processing device, by further including the content into the during-operation-mode process information; and

every time said display process is discriminated by said display process discrimination unit while said operation mode is kept selected by said operation mode selection unit, said display process information sending unit executes said sending process included in said during-operation-mode process information related to the selected operation mode.

8. :

The information processing device according to claim 5, wherein;

said ending process information storage unit stores the content of a sending process which sends said process content included in said ending process information to said another information processing device, by further including the content into the ending process information; and

when said operation mode selection unit has stopped keeping said operation mode selected, said display process information sending unit executes said sending process included in said ending process information related to the operation mode having been kept selected.

9. :

An information processing method comprising;

detecting contacting operation to display screen and a contact position of the operation;

keeping selecting, while said contact position is kept included in any one of one or more operation areas defined in advance within the area of said display screen, a predetermined operation mode related to the operation area;

detecting information representing a motion of the own device while said operation mode is kept selected;

discriminating a content of a display process designated with respect to screen data displayed on said display screen, on the basis a combination of said operation mode and said information representing a motion of the own device; and

executing discriminated said display process on said screen data.

10. :

A computer program for causing an information processing device to execute;

a process of detecting contacting operation to display screen and a contact position of the operation;

a process of keeping selecting, while said contact position is kept included in any one of one or more operation area defined in advance within the area of said display screen, a predetermined operation mode related to the operation area;

a process of detecting information representing a motion of the own device while said operation mode is kept selected;

a process of discriminating a content of a display process designated with respect to screen data displayed on said display screen, on the basis a combination of said operation mode and said information representing a motion of the own device; and

a process of executing discriminated said display process on said screen data.