TOUCH SCREEN DEVICE FOR ALLOWING BLIND PEOPLE TO OPERATE OBJECTS DISPLAYED THEREON AND OBJECT OPERATING METHOD IN THE TOUCH SCREEN DEVICE

• US 20120123781A1
• Filed: 02/11/2011
• Published: 05/17/2012
• Est. Priority Date: 11/11/2010
• Status: Abandoned Application

• Current Assignee: ATLab, Inc., S & I Solar Co., Ltd.
• Original Assignee: ATLab, Inc., S & I Solar Co., Ltd.
• Inventors: Park, Kun, Pak, Yong Suk
• Application Number:
  US13/025,598
• Publication Number:
  US 20120123781A1
• Time in Patent Office: Days
• US Class Current: 704/260
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

A touch screen device allowing blind people to operate objects displayed thereon and an object operating method in the touch screen device are provided. The touch screen device includes a touch sensing unit generating key values corresponding to touched ‘touch position'"'"'s of a virtual keyboard for controlling application software being executed, the number of touches and touch time and transmitting the key values to the application software when sensing touches of the virtual keyboard while the virtual keyboard is activated, an object determination unit reading text information of a focused object using hooking mechanism when the application software is executed based on the key values received from the touch sensing unit and the object among objects included in the application software is focused, and a speech synthesis unit converting the text information read by the object determination unit into speech data using a text-to-speech engine and outputting the speech data.

Claims

1. A touch screen device comprising:

a touch sensing unit generating key values corresponding to touched ‘

touch position'"'"'s of a virtual keyboard for controlling application software being executed, the number of touches and touch time and transmitting the key values to the application software when sensing touches of the virtual keyboard while the virtual keyboard is activated;

an object determination unit reading text information of a focused object using hooking mechanism when the application software is executed based on the key values received from the touch sensing unit and the object among objects included in the application software is focused; and

a speech synthesis unit converting the text information read by the object determination unit into speech data using a text-to-speech engine and outputting the speech data.

2. The touch screen device of claim 1, wherein the virtual keyboard includes a predetermined number of ‘

touch position'"'"'s arranged therein, is not visually displayed on the screen and operates in the background.

3. The touch screen device of claim 1, wherein the object is a component of the application software.

4. The touch screen device of claim 1, wherein the text information of the object includes the name, type and state of the object represented in a text.

5. The touch screen device of claim 1, wherein when the touch sensing unit senses a touch of a ‘

touch position’

to which a key value for a compass mode is allocated, the touch sensing unit requests the speech synthesis unit to output a voice message saying ‘

compass mode’ and

, when the touch sensing unit senses a touch of another ‘

touch position’

during the touch of the ‘

touch position’

of the ‘

compass mode’

, the touch sensing unit generates a key value corresponding to the newly touched ‘

touch position’ and

transmits the key value to the application software.

6. A method of operating an object displayed on a touch screen device by a blind person, comprising the steps of:

generating key values corresponding to touched ‘

touch position'"'"'s of a virtual keyboard for controlling application software being executed, the number of touches and touch time and transmitting the key values to the application software when touches of the virtual keyboard are sensed while the virtual keyboard is activated;

reading text information of a focused object using hooking mechanism when the application software is executed based on the key values and the object among objects included in the application software is focused; and

converting the read text information into speech data using a TTS engine and outputting the speech data.

7. The method of claim 6, wherein the step of generating the key values and transmitting the key values to the application software comprises the steps of:

outputting a voice message saying ‘

compass mode’

when a user touches a specific ‘

touch position’

for the compass mode; and

when a touch of another ‘

touch position’

is sensed in the compass mode, generating a key value corresponding to the newly touched ‘

touch position’ and

transmitting the key value to the application software being executed.