Information processing apparatus and method, and program for removing displayed objects based on a covered region of a screen

• US 9,710,096 B2
• Filed: 09/23/2009
• Issued: 07/18/2017
• Est. Priority Date: 10/06/2008
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sakurada, Akiko
• Primary Examiner(s): Vu, Kieu
• Assistant Examiner(s): BASOM, BLAINE T
• Application Number:
  US12/564,953
• Publication Number:
  US 20100088633A1
• Time in Patent Office: 2,855 Days
• Field of Search: 715702
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An information processing apparatus is provided which includes a display unit 110 for displaying an image on a screen based on image data, a contact and proximity detection unit 161 for detecting contact or proximity between a subject of operation and the surface of the display unit, a covered time measurement unit 165 for measuring covered time when the screen is covered by the contact or proximity of the subject of operation, and an object display control unit 166 for removing an object displayed in a covered region on the screen covered by the subject of operation from the covered region when the covered time is longer than a predetermined time.

Claims

1. An information processing apparatus, comprising:

at least one processor;

a display unit configured to display an image having one or more objects on a screen based on image data using the at least one processor;

at least one presence detection sensor;

a proximity detection unit configured to detect at least one of contact and proximity between a user'"'"'s hand and the screen, based on data received from the at least one presence detection sensor using the at least one processor;

a covered area calculation unit configured to calculate a covered area of a covered region comprising the size of the area that the user'"'"'s hand is in at least one of contact and in proximity to the at least one presence detection sensor using the at least one processor;

an overlapped area calculation unit configured to calculate an overlapped area of the one or more objects with the user'"'"'s hand, wherein the overlapped area is the size of the area where the covered region overlaps the object using the at least one processor;

a covered time measurement unit configured to measure a covered time when the screen is covered by at least one of contact and proximity of the user'"'"'s hand using the at least one processor; and

an object display control unit configured to remove the one or more objects from the covered region based on the measured cover time and the calculated overlapped area using the at least one processor,

wherein the object display control unit is configured to remove the one or more objects based on the covered region if the covered region represents at least a substantial portion of the user'"'"'s hand, and

wherein the at least the substantial portion of the user'"'"'s hand is greater than a user'"'"'s finger that is part of the user'"'"'s hand.

2. The information processing apparatus according to claim 1,

wherein

the object display control unit is configured to remove the one or more objects displayed in the covered region from the covered region when the covered area is larger than a predetermined value.

3. The information processing apparatus according to claim 2, wherein the covered area includes a portion of the screen in which the user'"'"'s hand moves about in at least one of contact and proximity to the screen during the covered time.

4. The information processing apparatus according to claim 1,

wherein

the object display control unit is configured to remove the one or more objects displayed in the covered region from the covered region when the overlapped area is larger than a predetermined value and when the covered time is longer than a predetermined time.

5. The information processing apparatus according to claim 1, wherein the object display control unit is configured to shift the one or more objects displayed in the covered region to a region outside the covered region and displays the one or more objects.

6. The information processing apparatus according to claim 5, wherein when the one or more objects is a plurality of objects, the object display control unit is configured to display the plurality of objects in alignment in the region outside the covered region on the screen.

7. The information processing apparatus according to claim 6, wherein the region outside the covered region on the screen is divided into a plurality of portions equal to a number of the plurality of objects removed.

8. The information processing apparatus according to claim 1, further comprising a new object display control unit configured to display a new object in the covered region after the object displayed in the covered region is removed from the covered region.

9. The information processing apparatus of claim 1, wherein the at least one presence detection sensor is at least one light receiving sensor comprising a plurality of pixel sets on the screen, wherein each pixel set comprises at least one color pixel the at least one light receiving sensor.

10. The information processing apparatus according to claim 9, wherein the proximity detection unit is configured to detect at least one of contact and proximity based on brightness values determined for the at least one of the light receiving sensor.

11. An information processing method, comprising the steps of:

displaying an image having one or more objects on a screen of a display unit based on image data;

detecting at least one of contact and proximity between a user'"'"'s hand and the screen;

calculating a covered area of a covered region comprising the size of the area that the user'"'"'s hand is in at least one of contact and in proximity to at least one presence detection sensor;

calculating an overlapped area of the one or more objects with the user'"'"'s hand, wherein the overlapped area is the size of the area where the covered region overlaps the object;

measuring covered time when the screen is covered by at least one of contact and proximity of the user'"'"'s hand; and

removing the one or more objects from the covered region based on the measured covered time and the calculated overlapped area,

wherein the screen comprises the presence detection sensor,

wherein the at least one of contact and proximity is detected based on data received from the at least one presence detection sensor,

wherein the removing the one or more objects based on the covered region is performed if the covered region represents at least a substantial portion of the user'"'"'s hand, and

wherein the at least the substantial portion of the user'"'"'s hand is greater than a user'"'"'s finger that is part of the user'"'"'s hand.

12. The information processing method according to claim 11, wherein the object is returned to its original position after a predetermined elapsed time of a lack of at least one of contact and proximity.

13. The information processing method according to claim 11, comprising removing the one or more objects displayed in the covered region from the covered region when the covered area is larger than a predetermined value.

14. The information processing method according to claim 11, comprising removing the one or more objects displayed in the covered region from the covered region when the overlapped area is larger than a predetermined value and when the covered time is longer than a predetermined time.

15. The information processing method according to claim 11, wherein the removing one or more objects from the covered region comprises shifting the one or more objects displayed in the covered region to a region outside the covered region.

16. The information processing method according to claim 15, wherein when the one or more objects is a plurality of objects, displaying the plurality of objects in alignments in the region outside the covered region on the screen.

17. A non-transitory computer readable storage medium having stored thereon a program for causing a computer to perform the steps of:

displaying an image having one or more objects on a screen of a display unit based on image data;

detecting at least one of contact and proximity between a user'"'"'s hand and the screen;

calculating a covered area of a covered region comprising the size of the area that the user'"'"'s hand is in at least one of contact and in proximity to at least one presence detection sensor;

calculating an overlapped area of the one or more objects with the user'"'"'s hand, wherein the overlapped area is the size of the area where the covered region overlaps the object;

measuring covered time when the screen is covered by at least one of contact and proximity of the user'"'"'s hand; and

removing the one or more objects from the covered region based on the measured covered time and the calculated overlapped area,

wherein the screen comprises the at least one presence detection sensor,

wherein the at least one of contact and proximity is detected based on data received from the at least one presence detection sensor,

wherein the removing the one or more objects based on the covered region is performed if the covered region represents at least a substantial portion of the user'"'"'s hand, and

wherein the at least the substantial portion of the user'"'"'s hand is greater than a user'"'"'s finger that is part of the user'"'"'s hand.

18. The non-transitory computer readable storage medium according to claim 17, wherein the program causes removing the one or more objects displayed in the covered region from the covered region when the covered area is larger than a predetermined value.

19. The non-transitory computer readable storage medium according to claim 17, wherein the program causes removing the one or more objects displayed in the covered region from the covered region when the overlapped area is larger than a predetermined value and when the covered time is longer than a predetermined time.

20. The non-transitory computer readable storage medium according to claim 17, wherein the removing one or more objects from the covered region comprises shifting the one or more objects displayed in the covered region to a region outside the covered region.

21. The non-transitory computer readable storage medium according to claim 20, wherein when the one or more objects is a plurality of objects, displaying the plurality of objects in alignments in the region outside the covered region on the screen.