Information processing device and method of processing information

• US 10,101,900 B2
• Filed: 01/09/2014
• Issued: 10/16/2018
• Est. Priority Date: 01/16/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Onishi, Yusuke
• Primary Examiner(s): Xia, Xuyang
• Application Number:
  US14/759,896
• Publication Number:
  US 20150355812A1
• Time in Patent Office: 1,741 Days
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Provided is an information processing device including: a display unit configured to display a screen including an operation target to be subjected to a contact operation; a first detection unit configured to detect an object on the display unit; a second detection unit configured to detect an operation unavailable region among display regions of the screen based on a detection result obtained by the first detection unit, the operation unavailable region being a region in which an operation using the operation target is unable to be performed; and a change processing unit configured to change a configuration of the screen based on priority that is set for each operation target and to allow the operation target to be displayed in an operation available region, the operation available region being a region other than the operation unavailable region.

Claims

1. An information processing device, comprising:

circuitry configured to;

display at least one operation target of a plurality of operation targets on a display screen,

wherein the at least one operation target is subjected to a user contact operation;

detect an object is placed on the display screen;

detect an operation unavailable region from a plurality of display regions of the display screen based on the detection of the object placed on the display screen,

wherein the at least one operation target is inoperable in the operation unavailable region;

determine a necessity of change of a configuration of the display screen for the at least one operation target of the plurality of operation targets,

wherein the determination of the necessity of the change of the configuration of the display screen is based on a priority that is set for the at least one operation target and a type of the detected object on the display screen;

change the configuration of the display screen based on the determination,

wherein the at least one operation target is displayed in an operation available region of a plurality of operation available regions on the display screen, and

wherein the operation available region is a first region of the plurality of display regions other than the operation unavailable region; and

display a first operation target of the plurality of operation targets, in the operation available region with a largest area among the plurality of operation available regions,

wherein the first operation target has a highest priority among the plurality of operation targets.

2. The information processing device according to claim 1,

wherein the circuitry is further configured to store first information indicating an availability of an operation, as the first information indicating a condition of a position of each of the plurality of display regions.

3. The information processing device according to claim 2,

wherein the circuitry is further configured to:

detect a difficult-to-operate region based on the detection of the object on the display screen, wherein the difficult-to-operate region is a second region of the plurality of display regions on which an obstacle is detected; and

store second information among the first information indicating the availability of the operation, third information indicating an unavailability of the operation, and fourth information indicating difficulty of the operation in the difficult-to-operate region, as the first information indicating the condition of the position of each of the plurality of display regions.

4. The information processing device according to claim 1,

wherein the circuitry is further configured to change the configuration of the display screen based on the at least one operation target in which a first ratio of a first area of the operation unavailable region to a second area of the at least one operation target is greater than a first threshold, and

wherein the first threshold varies based on the second area of the at least one operation target.

5. The information processing device according to claim 4,

wherein the circuitry is further configured to calculate a score for the determination of the necessity of the change of the configuration of the display screen for each of the plurality of operation targets,

wherein the determination of the necessity of the change of the configuration of the display screen is based on a weight, and

wherein the weight is based on the priority and the type of the detected object on the display screen.

6. The information processing device according to claim 5,

wherein the circuitry is further configured to calculate a first sum and a second sum and determine a type of the change in the configuration of the display screen based on a second ratio of the second sum to the first sum, and

wherein the first sum is a sum of respective scores of the plurality of operation targets included in the display screen, and the second sum is a sum of the respective scores of the plurality of operation targets in which the first ratio of the first area of the operation unavailable region to the second area of the at least one operation target is greater than the first threshold.

7. The information processing device according to claim 6,

wherein the circuitry is further configured to:

determine that the change of the configuration of the display screen is unnecessary based on the second ratio that is smaller than a second threshold, and

determine that the configuration of the display screen is unable to change based on the second ratio of the second sum to the first sum that is greater than a third threshold.

8. The information processing device according to claim 7,

wherein the circuitry is further configured to change the display of the at least one operation target in which the first ratio of the first area of the operation unavailable region to the second area of the at least one operation target is greater than the first threshold, with the configuration of the display screen unchanged, based on the second ratio of the second sum to the first sum that is smaller than the second threshold.

9. The information processing device according to claim 7,

wherein the circuitry is further configured to display information indicating the at least one operation target in which the first ratio of the first area of the operation unavailable region to the second area of the at least one operation target is greater than the first threshold is inoperable with the configuration of the display screen unchanged, based on the second ratio of the second sum to the first sum that is smaller than the second threshold.

10. The information processing device according to claim 1,

wherein the circuitry is further configured to change the configuration of the display screen such that the first operation target is displayed in the operation available region.

11. The information processing device according to claim 10,

wherein the at least one operation target from the plurality of operation targets is displayed in the operation available region based on the plurality of operation targets having identical priority.

12. The information processing device according to claim 10,

wherein the circuitry is further configured to display a button in the operation available region and display a second operation target among the plurality of operation targets, in the operation available region based on an operation of the button.

13. The information processing device according to claim 1,

wherein the circuitry is further configured to display the plurality of operation targets included in the display screen in the operation available region in a reduced form with arrangement of each operation target maintained.

14. The information processing device according to claim 13,

wherein the circuitry is further configured to display information assigned to the at least one operation target of the plurality of operation targets in one of the reduced form or an abbreviated form.

15. The information processing device according to claim 1,

wherein the circuitry is further configured to display the plurality of operation targets included in the display screen in the operation available region with a change in arrangement of each operation target of the plurality of operation targets.

16. The information processing device according to claim 15,

wherein the circuitry is further configured to display information assigned to the at least one operation target in one of a reduced form or an abbreviated form.

17. A method, comprising:

displaying at least one operation target of a plurality of operation targets on a display screen,

wherein the at least one operation target is subjected to a user contact operation;

detecting an object is placed on the display screen;

detecting an operation unavailable region from a plurality of display regions of the display screen based on the detection of the object placed on the display screen,

wherein the at least one operation target is inoperable in the operation unavailable region;

determining a necessity of change of a configuration of the display screen for the at least one operation target of the plurality of operation targets,

wherein the determination of the necessity of the change of the configuration of the display screen is based on a priority that is set for the at least one operation target and a type of the detected object on the display screen;

changing the configuration of the display screen based on the determination,

wherein the at least one operation target is displayed in an operation available region of a plurality of operation available regions on the display screen, and

wherein the operation available region is a region of the plurality of display regions other than the operation unavailable region; and

displaying an operation target of the plurality of operation targets, in the operation available region with a largest area among the plurality of operation available regions,

wherein the operation target has a highest priority among the plurality of operation targets.

18. A non-transitory computer-readable medium having stored thereon computer-executable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:

displaying at least one operation target of a plurality of operation targets on a display screen,

wherein the at least one operation target is subjected to a user contact operation;

detecting an object is placed on the display screen;

detecting an operation unavailable region from a plurality of display regions of the display screen based on the detection of the object placed on the display screen,

wherein the at least one operation target is inoperable in the operation unavailable region;

determining a necessity of change of a configuration of the display screen for the at least one operation target of the plurality of operation targets,

wherein the determination of the necessity of the change of the configuration of the display screen is based on a priority that is set for the at least one operation target and a type of the detected object on the display screen;

changing the configuration of the display screen based on the determination,

wherein the at least one operation target is displayed in an operation available region of a plurality of operation available regions on the display screen,

wherein the operation available region is a region of the plurality of display regions other than the operation unavailable region; and

displaying an operation target of the plurality of operation targets, in the operation available region with a largest area among the plurality of operation available regions,

wherein the operation target has a highest priority among the plurality of operation targets.