SELF-HEALING AND DIAGNOSTIC SCREEN

• US 20090160780A1
• Filed: 12/21/2007
• Published: 06/25/2009
• Est. Priority Date: 12/21/2007
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: ARNOLD, NICOLE M., Seacat, Lisa A., Do, Lydia M., Nesbitt, Pamela A.
• Granted Patent: US 8,525,796 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment

Abstract

A method, system, and computer program product for determining a level of cleanliness of a multi-touch screen display, characterizing objects that make contact with the screen, and initiating a specific maintenance action on the screen, based on screen cleanliness and the object(s) characterization(s). A screen diagnostic and maintenance (SDM) utility initiates a number of procedures to determine the type of object(s) and a set of characteristics of object(s) that make contact with the touch screen. Based on the results of the procedures, the SDM utility characterizes/identifies the object(s). In addition, the SDM utility initiates maintenance screen check(s) based on information stored in maintenance configuration file(s). Based on the results of the maintenance check(s), configuration file(s) data and type and characterization of the object(s) that have made contact with the screen, the SDM utility determines the type of maintenance that is performed and the timing/schedule of the maintenance action(s).

Claims

1. In an electronic device having a touch screen display (touch screen), a method comprising:

detecting an occurrence of a contact by the object with the touch screen;

automatically determining a set of characteristics of the object following the occurrence of the contact with the touch screen; and

dynamically activating a set of maintenance actions to enhance a level of cleanliness of the touch screen.

2. The method of claim 1 further comprising:

storing data pertaining to the set of characteristics of the object; and

performing a number of maintenance checks at specific time intervals based on one or more of the following;

(1) a set of configuration data; and

(2) a set of data stored in one or more files of maintenance records and results.

3. The method of claim 1, wherein said determining further comprises:

identifying the set of characteristics of the object with an application of one or more of the following procedures;

(1) a temperature measurement of the object;

(2) a weight measurement of the object;

(3) a determination of a location of the object on the screen;

(4) an image capture of the object;

(5) determining a type of the object with an aid of a set of applications which set includes one or more applications based on an object recognition technology;

(6) a determination of a set of physical dimensions of the object;

(7) a determination of a physical state of the object;

(8) a determination of a mobility of the object;

(9) a determination of a viscosity of the object; and

tracking one or more of a set of dynamic characteristics of the object with an update of values from one or more of said procedures.

4. The method of claim 1, wherein:

said detecting includes simultaneously detecting multiple objects at one or more areas of the touch screen with the aid of a multi-detection mechanism; and

said determining includes determining the set of characteristics of the multiple objects.

5. The method of claim 1, wherein said activating further comprises:

triggering the set of maintenance actions as a result of one or more of the following factors;

(1) a characteristic of a detected object;

(2) a threshold level attained following the occurrence of the contact, wherein said threshold is preset, based on a number of factors contained within a maintenance configuration file;

(3) an elapsed time interval since a last maintenance action;

(4) an identified level of screen cleanliness that is determined by one or more procedures, including utilization of opacity sensors;

(5) a time of day;

(6) a level of interaction between a user and the touch screen; and

(7) a set of configuration data.

6. The method of claim 5 further comprising:

applying the set of maintenance actions, including providing one or more of the following;

(1) a visual change in a particular screen location;

(2) an audio alert;

(3) a usage restriction of the screen area;

(4) a temperature alert;

(5) a modification of a pixel resolution around the particular area;

(6) a constant indicator, wherein said constant indicator includes one or more mechanisms, including;

(a) a visual effect that includes a highlighting mechanism facilitated by a display of one or more of icons and arrows on the screen at a location within a preset range of distances to the affected area;

(b) a touch sensory mechanism that includes one or more of a heating and cooling of an affected screen area when touched by the object; and

(c) an audio sensory mechanism that includes a sound that increases in sound level when an object is positioned within a defined proximity of the affected area;

(7) an application of a transparent film to the screen surface; and

(8) a utilization of a wiper mechanism that dispenses cleaning material across the screen surface.

7. The method of claim 6, further comprising one or more of:

displaying a list of maintenance tasks to be completed by a user to execute a maintenance action;

enabling execution of the maintenance action via the displayed list, wherein a user is able to interact with said list to indicate a completion of one or more tasks on the list; and

providing the maintenance action via an external screen protection device, wherein said screen protection device has blue-tooth capability that enables communication between the protection device and the electronic device in order to provide an appropriate set of details of the affected area of the screen to the protection device.

8. The method of claim 1, further comprising:

detecting one or more defects in one or more display screen pixels; and

when a defect is detected, triggering a set of maintenance actions based on a defect of the display screen pixels;

wherein a discovery of said defect of the screen pixels is facilitated by one or more maintenance actions which include a cleaning action of the touch screen, wherein said maintenance actions enable an identification of a persistent problem with the screen display, which is not attributable to the level of cleanliness of the screen; and

wherein said defect of the screen pixels is confirmed by a set of results obtained by a test of the screen pixels.

9. An electronic device comprising:

a processor;

a memory system which stores one or more of a maintenance configuration file, a maintenance records file, and an object recognition utility;

a multiple detection touch screen, having the object recognition utility executing on the processor;

a screen diagnostic and maintenance (SDM) utility which when executed by the processor enables functions of;

detecting an occurrence of a contact by the object with the touch screen;

automatically determining a set of characteristics of the object following the occurrence of the contact with the touch screen; and

dynamically activating a set of maintenance actions to enhance a level of cleanliness of the touch screen.

10. The device of claim 9, wherein the SDM utility further provides the functions of:

storing data pertaining to the set of characteristics of the object; and

performing a number of maintenance checks at specific time intervals based on one or more of;

(1) a set of configuration data; and

(2) a set of data stored in one or more files of maintenance records and results.

11. The device of claim 9, wherein said determining function further comprises the functions of:

identifying the set of characteristics of the object with an application of one or more of;

(1) a temperature measurement of the object;

(2) a weight measurement of the object;

(3) a determination of a location of the object on the screen;

(4) an image capture of the object;

(5) determining a type of the object with an aid of a set of applications which set includes one or more applications based on an object recognition technology;

(6) a determination of a set of physical dimensions of the object;

(7) a determination of a physical state of the object;

(8) a determination of a mobility of the object;

(9) a determination of a viscosity of the object; and

tracking one or more of a set of dynamic characteristics of the object with an update of values from one or more of said procedures.

12. The device of claim 9, wherein:

said function of detecting includes simultaneously detecting multiple objects at one or more areas of the touch screen with the aid of a multi-detection mechanism; and

said function of determining includes determining the set of characteristics of the multiple objects.

13. The device of claim 9, wherein said activating further comprises functions of:

triggering the set of maintenance actions as a result of one or more of the following factors;

(1) a characteristic of a detected object;

(2) a threshold level attained following the occurrence of the contact, wherein said threshold is based on a number of factors contained within a maintenance configuration file;

(3) an elapsed time interval since a last maintenance action;

(4) an identified level of screen cleanliness that is determined by one or more procedures, including utilization of opacity sensors;

(5) a time of day;

(6) a level of interaction between a user and the touch screen; and

(7) a set of configuration data.

14. The device of claim 13, further comprising:

a screen maintenance facility, which provides a number of maintenance actions, including one or more of the following;

(1) a visual highlighting notification;

(2) a sound notification; and

(3) a sensory and temperature notification;

wherein the SDM utility further provides the functions of;

applying the set of maintenance actions, including one or more of the following;

(1) a visual change in a particular screen location;

(2) an audio alert;

(3) a usage restriction of the screen area;

(4) a temperature alert;

(5) a modification of a pixel resolution around the particular area;

(6) a constant indicator, wherein said constant indicator includes one or more of and is not limited to the following;

(a) a visual effect that includes a highlighting mechanism facilitated by a display of one or more of icons and arrows on the screen at a location within a preset range of distances to the affected area;

(b) a touch sensory mechanism that includes one or more of a heating and cooling of an affected screen area when touched by the object; and

(c) an audio sensory mechanism that includes a sound that increases in sound level when an object is positioned within a defined proximity of the affected area;

(7) an application of a transparent film to the screen surface; and

(8) a utilization of a wiper mechanism that dispenses cleaning material across the screen surface.

15. The device of claim 14, said SDM utility further providing the functions of:

displaying a list of maintenance tasks to be completed by a user to execute a maintenance action;

enabling execution of the maintenance action via the displayed list, wherein a user is able to interact with said list to indicate a completion of one or more tasks on the list;

providing a maintenance action via an external screen protection device, wherein said screen protection device has a blue-tooth capability, which enables communication between the protection device and the electronic device in order to provide an appropriate set of details of the affected area of the screen to the protection device; and

detecting one or more defects in one or more display screen pixels; and

when a defect is detected, triggering a set of maintenance actions based on the defect of the display screen pixels;

wherein a discovery of said defect of the screen pixels is facilitated by one or more maintenance actions which include a cleaning action of the touch screen, wherein said maintenance actions enable an identification of a persistent problem with the screen display, which is not attributable to the level of cleanliness of the screen; and

wherein said defect of the screen pixels is confirmed by a set of results obtained by a test of the screen pixels.

16. A computer program product comprising:

a computer readable medium; and

program code on said computer readable medium that when executed by a processing device having a touch screen display (touch screen), provides the functions of;

receiving data indicating a detection of an occurrence of a contact by one or more objects with the touch screen;

automatically determining a set of characteristics of the one or more objects following the occurrence of the contact with the touch screen; and

dynamically activating a set of maintenance actions to enhance a level of cleanliness of the touch screen.

17. The computer program product of claim 16, wherein for at least one object of the one or more objects, said program code further comprises code for:

identifying the set of characteristics of the object with an application of one or more of the following procedures;

(1) a temperature measurement of the object;

(2) a weight measurement of the object;

(3) a determination of a location of the object on the screen;

(4) an image capture of the object;

(5) determining a type of the object with an aid of a set of applications which set includes one or more applications based on an object recognition technology;

(6) a determination of a set of physical dimensions of the object;

(7) a determination of a physical state of the object;

(8) a determination of a mobility of the object;

(9) a determination of a viscosity of the object;

tracking one or more of a set of dynamic characteristics of the object with an update of values from one or more of said procedures;

storing data pertaining to the set of characteristics of the object; and

performing a number of maintenance checks at a set of specific time intervals based on one or more of the following;

(1) a set of configuration data; and

(2) a set of data stored in one or more files of maintenance records and results.

18. The computer program product of claim 16, wherein said code for activating further comprises code for:

triggering the set of maintenance actions as a result of one or more of the following factors;

(1) a characteristic of a detected object;

(2) a threshold level attained following the occurrence of the contact, wherein said threshold is based on one or more factors contained within a maintenance configuration file;

(3) an elapsed time interval since a last maintenance action;

(4) an identified level of screen cleanliness that is determined by one or more procedures, including utilization of opacity sensors;

(5) a time of day;

(6) a level of interaction between a user and the touch screen; and

(7) a set of configuration data.

19. The computer program product of claim 18, further comprising code for:

applying the set of maintenance actions, including one or more of the following;

(1) a visual change in a particular screen location;

(2) an audio alert;

(3) a usage restriction of the screen area;

(4) a temperature alert;

(5) a modification of a pixel resolution around the particular area; and

(6) a constant indicator, wherein said constant indicator includes one or more of and is not limited to the following;

(a) a visual effect that includes a highlighting mechanism facilitated by a display of one or more of icons and arrows on the screen at a location within a preset range of distances to the affected area;

(b) a touch sensory mechanism that includes one or more of a heating and cooling of an affected screen area when touched by the object; and

(c) an audio sensory mechanism that includes a sound that increases in sound level when an object is positioned within a defined proximity of the affected area;

(7) an application of a transparent film to the screen surface; and

(8) a utilization of a wiper mechanism that dispenses cleaning material across the screen surface.

20. The computer program product of claim 16, further comprising code for:

displaying a list of maintenance tasks to be completed by a user to execute a maintenance action;

enabling execution of the maintenance action via the displayed list, wherein a user is able to interact with said list to indicate a completion of one or more tasks on the list;

providing a maintenance action via an external screen protection device, wherein said screen protection device has a blue-tooth capability, which enables communication between the protection device and the electronic device in order to provide an appropriate set of details of the affected area of the screen to the protection device;

detecting one or more defects in one or more display screen pixels; and

when a defect is detected, triggering a set of maintenance actions based on a defect of the display screen pixels;

wherein a discovery of said defect of the screen pixels is facilitated by one or more maintenance actions which include a cleaning action of the touch screen, wherein said maintenance actions enable an identification of a persistent problem with the screen display, which is not attributable to the level of cleanliness of the screen; and

wherein said defect of the screen pixels is confirmed by a set of results obtained by a test of the screen pixels.