SIGN LANGUAGE RECOGNITION SYSTEM AND METHOD

• US 20110151846A1
• Filed: 04/01/2010
• Published: 06/23/2011
• Est. Priority Date: 12/17/2009
• Status: Active Grant

• Current Assignee: Chi Mei Communication Systems Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Chi Mei Communication Systems Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: LIN, YUNG-CHUAN ONEAL
• Granted Patent: US 8,428,643 B2
• Time in Patent Office: Days
• US Class Current: 455/414.2
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04M 1/72478 for hearing-impaired users
• CPC Class Codes: H04M 2250/70 methods for entering alphabetical characters, e.g. multi-tap or dictionary disambiguation methods for entering alphabetical characters per se G06F3/0237

Abstract

A sign language recognition system includes a menu generating module, an image processing module, and text processing module. The image processing module controls an image capturing unit to capture a gesture image of a target person when an image recognition icon is selected, extracts sign language data from the gesture image, and transmits the sign data packet to a server for analyzing the sign language data to generate sign recognition information. The text processing module packs text data to be sent to a reception device, and a reception language and a phone number of the reception device to generate a text data packet when a text recognition icon is selected, and sends the text data packet to the server for analyzing the text data to generate a sign recognition image recognizable by the reception device.

Claims

1. A sign language recognition system, the system being implemented by a mobile device connected to a server through a network, the mobile device comprising an image capturing unit and a display screen, the system sign language recognition comprising:

a menu generating module operable to generate and display a main menu interface on the display screen, the main menu interface comprising an image recognition icon and a text recognition icon;

an image processing module operable to control the image capturing unit to capture a gesture image of a target person when the image recognition icon is selected, extract sign language data from the gesture image according to body language of the target person, pack the sign language data and a preset language of the mobile device to generate a sign data packet, and transmit the sign data packet to the server for analyzing the sign language data to generate sign recognition information; and

a text processing module operable to pack text data to be sent to a reception device, and a reception language and a phone number of the reception device to generate a text data packet when the text recognition icon is selected, and send the text data packet to the server for analyzing the text data to generate a sign recognition image recognizable by the reception device.

2. The sign language recognition system according to claim 1, wherein the server connects to a data storage device that stores a sign language standard and a text analysis standard.

3. The sign language recognition system according to claim 2, wherein the server comprises:

a sign language analysis unit operable to analyze the sign data packet to generate a sign analysis result according to the sign language standard when the server receives the sign data packet from the mobile device, convert the sign analysis result into the sign recognition information according to the preset language of the mobile device, and send the sign recognition information to the mobile device through the network.

4. The sign language recognition system according to claim 2, wherein the server comprises:

a text analysis unit operable to analyze the text data packet to generate a text analysis result according to the text analysis standard when the server receives the text data packet from the mobile device, convert the text analysis result into the sign recognition image according to the sign language standard, and transmit the sign recognition image to the reception device according to the reception phone number.

5. The sign language recognition system according to claim 1, wherein the menu generating module is further operable to generate and display a submenu interface on the display screen when the text recognition icon of the main menu interface is selected.

6. The sign language recognition system according to claim 5, wherein the submenu interface comprises a text input box, a language selection icon, a phone number input icon, a text analysis icon, and an interface return icon.

7. The sign language recognition system according to claim 6, wherein text data is input from text input box, the reception language of the reception device is selected from language selection icon, and the phone number of the reception device is input from the phone number input icon.

8. A sign language recognition method for a mobile device, the mobile device being connected to a server through a network and comprising an image capturing unit and a display screen, the method comprising:

generating and displaying a main menu interface on the display screen, the main menu interface comprising an image recognition icon and a text recognition icon;

determining whether the image recognition icon or the text recognition icon is selected;

in response to the image recognition icon being selected, executing block (a1) to block (a5);

(a1) controlling the image capturing unit to capture a gesture image of a target person;

(a2) extracting sign language data from the gesture image according to body language of the target person;

(a3) packing the sign language data and a preset language of the mobile device to generate a sign data packet;

(a4) transmitting the sign data packet to the server for analyzing the sign language data to generate sign recognition information;

(a5) receiving the sign recognition information from the server, and displaying the sign recognition information in format of the preset language on the display screen;

in response to the text recognition icon being selected, executing block (b1) to block (b3);

(b1) packing text data to be sent to a reception device, and a reception language and a phone number of the reception device to generate a text data packet;

(b2) transmitting the text data packet to the server for analyzing the text data to generate a sign recognition image recognizable by the reception device; and

(b3) receiving the sign recognition image from the server, and displaying the sign recognition image on the reception device.

9. The method according to claim 8, wherein the server connects to a data storage device that stores a sign language standard and a text analysis standard.

10. The method according to claim 9, wherein the block (a4) comprises:

analyzing the sign data packet to generate a sign analysis result according to the sign language standard when the server receives the sign data packet from the mobile device;

converting the sign analysis result into the sign recognition information according to the preset language of the mobile device; and

sending the sign recognition information to the mobile device through the network.

11. The method according to claim 9, wherein the block (b2) comprises:

analyzing the text data packet to generate a text analysis result according to the text analysis standard when the server receives the text data packet from the mobile device;

converting the text analysis result into the sign recognition image according to the sign language standard; and

transmitting the sign recognition image to the reception device according to the reception phone number.

12. The method according to claim 8, further comprising:

generating and displaying a submenu interface on the display screen when the text recognition icon of the main menu interface is selected.

13. The method according to claim 12, wherein the submenu interface comprises a text input box for inputting the text data to be sent to the reception device, a language selection icon for selecting the reception language of the reception device, and a phone number input icon for inputting the phone number of the reception device.

14. A storage medium having stored thereon instructions that, when executed by a processor of a mobile device, cause the mobile device to perform a method for recognizing sign language, the method comprising:

generating and displaying a main menu interface on the display screen, the main menu interface comprising an image recognition icon and a text recognition icon;

determining whether the image recognition icon or the text recognition icon is selected;

in response to the image recognition icon being selected, executing block (a1) to block (a5);

(a1) controlling the image capturing unit to capture a gesture image of a target person;

(a2) extracting sign language data from the gesture image according to body language of the target person;

(a3) packing the sign language data and a preset language of the mobile device to generate a sign data packet;

(a4) transmitting the sign data packet to a server for analyzing the sign language data to generate sign recognition information; and

(a5) receiving the sign recognition information from the server, and displaying the sign recognition information in format of the preset language on the display screen;

in response to the text recognition icon being selected, executing block (b1) to block (b3);

(b1) packing text data to be sent to a reception device, and a reception language and a phone number of the reception device to generate a text data packet;

(b2) transmitting the text data packet to the server for analyzing the text data to generate a sign recognition image recognizable by the reception device; and

(b3) receiving the sign recognition image from the server, and displaying the sign recognition image on the reception device.

15. The storage medium according to claim 14, wherein the server connects to a data storage device that stores a sign language standard and a text analysis standard.

16. The storage medium according to claim 15, wherein the block (a4) comprises:

analyzing the sign data packet to generate a sign analysis result according to the sign language standard when the server receives the sign data packet from the mobile device;

converting the sign analysis result into the sign recognition information according to the preset language of the mobile device; and

sending the sign recognition information to the mobile device through the network.

17. The storage medium according to claim 15, wherein the block (b2) comprises:

analyzing the text data packet to generate a text analysis result according to the text analysis standard when the server receives the text data packet from the mobile device;

converting the text analysis result into the sign recognition image according to the sign language standard; and

transmitting the sign recognition image to the reception device according to the reception phone number.

18. The storage medium according to claim 14, wherein the method further comprises:

generating and displaying a submenu interface on the display screen when the text recognition icon of the main menu interface is selected.

19. The storage medium according to claim 18, wherein the submenu interface comprises a text input box for inputting the text data to be sent to the reception device, a language selection icon for selecting the reception language of the reception device, and a phone number input icon for inputting the phone number of the reception device.