Information processing apparatus, information processing method, program, and information processing system

• US 9,772,744 B2
• Filed: 04/12/2013
• Issued: 09/26/2017
• Est. Priority Date: 04/19/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yamano, Ikuo, Yamamoto, Kazuyuki
• Primary Examiner(s): Siddiqui, Md Saiful A
• Application Number:
  US14/385,381
• Publication Number:
  US 20150040070A1
• Time in Patent Office: 1,628 Days
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

There is provided an information processing apparatus including an operation surface configured to receive touch inputs, and a sensor unit configured to detect at least one right-side touch input from a manipulation by a user of the operation surface within a first operational area of the operation surface, and at least one left-side touch input from a manipulation by the user of the operation surface within a second operational area of the operation surface, wherein the first operational area and the second operational area of the operation surface are mapped to a graphical user interface (GUI) area of a display device.

Claims

1. An information processing apparatus comprising:

an operation surface configured to receive touch inputs;

a sensor unit configured to detect at least one right-side touch input from a manipulation by a user of the operation surface within a first operational area of the operation surface, and at least one left-side touch input from a manipulation by the user of the operation surface within a second operational area of the operation surface, and

a click switch which detects a pressing operation,

wherein the first operational area and the second operational area of the operation surface are mapped to a graphical user interface (GUI) area of a display device,

wherein the first operational area of the operation surface is mapped to a left side area of the GUI area of the display device, and the second operational area of the operation surface is mapped to a right side area of the GUI area of the display device,

wherein the GUI area comprises an on-screen keyboard (OSK), and a letter of the OSK is determined based on the pressing operation,

wherein a first preview letter associated with the at least one right-side touch input and a second preview letter associated with the at least one left-side touch input are concurrently displayed, as candidates for the determined letter, in a preview display of the display device,

wherein the first preview letter is displayed in the preview display within a first predefined display area different than the OSK and dedicated to the displaying of the first preview letter, and the second preview letter is displayed in the preview display within a second predefined display area different than the OSK and dedicated to the displaying of the second preview letter, the second predefined display area being located directly adjacent to the first predefined display area, and

wherein the sensor unit is implemented via at least one processor.

2. The information processing apparatus of claim 1, wherein, upon detection of a first operation tool approaching the operation surface for delivering the at least one right-side touch input, a first focus corresponding to the detected approaching first operation tool is displayed in the GUI area of the display device, wherein, upon detection of a second operation tool approaching the operation surface for delivering the at least one left-side touch input, a second focus corresponding to the detected approaching second operation tool is displayed in the GUI area of the display device, and wherein the first operation tool and the second operation tool are distinguishable as different objects that approach the operation surface.

3. The information processing apparatus of claim 1, wherein the sensor unit recognizes each of the touch inputs as either a right-hand touch input or a left-hand touch input based on x-coordinate locations of points at which respective touch inputs are made on the operation surface.

4. The information processing apparatus of claim 1, wherein the sensor unit recognizes each of the touch inputs as either a right-hand touch input or a left-hand touch input based on a shadow shape made on the operation surface when the operation surface receives a respective touch input.

5. The information processing apparatus of claim 1, wherein the first operational area of the operation surface is mapped to a first section of the OSK of the left side area of the GUI area of the display device, and the second operational area of the operation surface is mapped to a second section of the OSK of the right side area of the GUI area of the display device.

6. The information processing apparatus of claim 1, wherein a second GUI is overlaid on an area of the operation surface, the second GUI corresponding to the GUI area of the display device.

7. The information processing apparatus of claim 1, wherein a text-entry portion of the operation surface is mapped to the OSK of the GUI area of the display device.

8. The information processing apparatus of claim 7, wherein a mapping size ratio of mapping the text-entry portion of the operation surface to the OSK of the GUI area of the display device is larger than a mapping size ratio of other portions of the operation surface mapped to corresponding portions of the GUI area of the display device.

9. The information processing apparatus of claim 1, wherein the sensor unit is configured to recognize the touch inputs received by the operation surface as either right-hand touch inputs or left-hand touch inputs.

10. The information processing apparatus of claim 1, wherein, upon detection of the at least one right-side touch input, a first focus corresponding to the detected at least one right-side touch input is displayed in the GUI area of the display device, and wherein, upon detection of the at least one left-side touch input, a second focus corresponding to the detected at least one left-side touch input is displayed in the GUI area of the display device.

11. The information processing apparatus of claim 10, wherein the first focus is not displayed in the GUI area of the display device when the at least one right-side touch input is no longer detected, and the second focus is not displayed in the GUI area of the display device when the at least one left-side touch input is no longer detected.

12. The information processing apparatus of claim 10, wherein the first focus and the second focus each comprise a pointer icon.

13. The information processing apparatus of claim 10, wherein the first focus and the second focus each comprise a highlighting of a respective associated region within the GUI area.

14. The information processing apparatus of claim 10, wherein the first focus and the second focus each comprise a highlighting of a respective associated key of the OSK displayed within the GUI area of the display device.

15. The information processing apparatus of claim 1, wherein the sensor unit is further configured to recognize touch inputs received by the operation surface to be inputs made by different operation objects.

16. The information processing apparatus of claim 15, wherein the different operation objects comprise different human hands.

17. The information processing apparatus of claim 1, wherein the GUI area of the display device to which the first operational area and the second operational area of the operation surface are mapped is smaller than a total display area of the display device.

18. The information processing apparatus of claim 1, wherein the key that is within the left side area of the GUI area of the display device is the same as the key that is within the right side area of the GUI area of the display device.

19. The information processing apparatus of claim 1, wherein the left side area of the GUI area of the display device and the right side area of the GUI area of the display device do not overlap.

20. The information processing apparatus of claim 1, wherein the operation surface has a space between the first operational area and the second operational area.

21. The information processing apparatus of claim 20, wherein the first operational area is spaced apart and separated from the second operational area by the space on the operation surface.

22. The information processing apparatus of claim 1, wherein a portion of the operational surface between the first operational area and the second operational has an area is not mapped to the GUI area.

23. An information processing method comprising:

mapping a first operational area and a second operational area of an operation surface of a terminal device to a graphical user interface (GUI) area of a display device;

detecting at least one right-side touch input from a manipulation by a user of the operation surface within the first operational area of the operation surface;

detecting at least one left-side touch input from a manipulation by the user of the operation surface within the second operational area of the operation surface; and

detecting a pressing operation via a click switch,

wherein the first operational area of the operation surface is mapped to a left side area of the GUI area of the display device, and the second operational area of the operation surface is mapped to a right side area of the GUI area of the display device,

wherein the GUI area comprises an on-screen keyboard (OSK), and a letter of the OSK is determined based on the pressing operation,

wherein a first preview letter associated with the at least one right-side touch input and a second preview letter associated with the at least one left-side touch input are concurrently displayed, as candidates for the determined letter, in a preview display of the display device, and

wherein the first preview letter is displayed in the preview display within a first predefined display area different than the OSK and dedicated to the displaying of the first preview letter, and the second preview letter is displayed in the preview display within a second predefined display area different than the OSK and dedicated to the displaying of the second preview letter, the second predefined display area being located directly adjacent to the first predefined display area.

24. A non-transitory computer-readable medium embodied with a program, which when executed by a computer, causes the computer to execute a method, the method comprising:

mapping a first operational area and a second operational area of an operation surface of a terminal device to a graphical user interface (GUI) area of a display device;

detecting at least one right-side touch input from a manipulation by a user of the operation surface within the first operational area of the operation surface;

detecting at least one left-side touch input from a manipulation by the user of the operation surface within the second operational area of the operation surface; and

detecting a pressing operation via a click switch,

wherein the first operational area of the operation surface is mapped to a left side area of the GUI area of the display device, and the second operational area of the operation surface is mapped to a right side area of the GUI area of the display device,

wherein the GUI area comprises an on-screen keyboard (OSK), and a letter of the OSK is determined based on the pressing operation,

wherein a first preview letter associated with the at least one right-side touch input and a second preview letter associated with the at least one left-side touch input are concurrently displayed, as candidates for the determined letter, in a preview display of the display device, and

wherein the first preview letter is displayed in the preview display within a first predefined display area different than the OSK and dedicated to the displaying of the first preview letter, and the second preview letter is displayed in the preview display within a second predefined display area different than the OSK and dedicated to the displaying of the second preview letter, the second predefined display area being located directly adjacent to the first predefined display area.