SIGN LANGUAGE RECOGNITION SYSTEM AND METHOD
First Claim
1. A sign language recognition system, the system being implemented by a mobile device connected to a server through a network, the mobile device comprising an image capturing unit and a display screen, the system sign language recognition comprising:
- a menu generating module operable to generate and display a main menu interface on the display screen, the main menu interface comprising an image recognition icon and a text recognition icon;
an image processing module operable to control the image capturing unit to capture a gesture image of a target person when the image recognition icon is selected, extract sign language data from the gesture image according to body language of the target person, pack the sign language data and a preset language of the mobile device to generate a sign data packet, and transmit the sign data packet to the server for analyzing the sign language data to generate sign recognition information; and
a text processing module operable to pack text data to be sent to a reception device, and a reception language and a phone number of the reception device to generate a text data packet when the text recognition icon is selected, and send the text data packet to the server for analyzing the text data to generate a sign recognition image recognizable by the reception device.
1 Assignment
0 Petitions
Accused Products
Abstract
A sign language recognition system includes a menu generating module, an image processing module, and text processing module. The image processing module controls an image capturing unit to capture a gesture image of a target person when an image recognition icon is selected, extracts sign language data from the gesture image, and transmits the sign data packet to a server for analyzing the sign language data to generate sign recognition information. The text processing module packs text data to be sent to a reception device, and a reception language and a phone number of the reception device to generate a text data packet when a text recognition icon is selected, and sends the text data packet to the server for analyzing the text data to generate a sign recognition image recognizable by the reception device.
22 Citations
19 Claims
-
1. A sign language recognition system, the system being implemented by a mobile device connected to a server through a network, the mobile device comprising an image capturing unit and a display screen, the system sign language recognition comprising:
-
a menu generating module operable to generate and display a main menu interface on the display screen, the main menu interface comprising an image recognition icon and a text recognition icon; an image processing module operable to control the image capturing unit to capture a gesture image of a target person when the image recognition icon is selected, extract sign language data from the gesture image according to body language of the target person, pack the sign language data and a preset language of the mobile device to generate a sign data packet, and transmit the sign data packet to the server for analyzing the sign language data to generate sign recognition information; and a text processing module operable to pack text data to be sent to a reception device, and a reception language and a phone number of the reception device to generate a text data packet when the text recognition icon is selected, and send the text data packet to the server for analyzing the text data to generate a sign recognition image recognizable by the reception device. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A sign language recognition method for a mobile device, the mobile device being connected to a server through a network and comprising an image capturing unit and a display screen, the method comprising:
-
generating and displaying a main menu interface on the display screen, the main menu interface comprising an image recognition icon and a text recognition icon; determining whether the image recognition icon or the text recognition icon is selected; in response to the image recognition icon being selected, executing block (a1) to block (a5); (a1) controlling the image capturing unit to capture a gesture image of a target person; (a2) extracting sign language data from the gesture image according to body language of the target person; (a3) packing the sign language data and a preset language of the mobile device to generate a sign data packet; (a4) transmitting the sign data packet to the server for analyzing the sign language data to generate sign recognition information; (a5) receiving the sign recognition information from the server, and displaying the sign recognition information in format of the preset language on the display screen; in response to the text recognition icon being selected, executing block (b1) to block (b3); (b1) packing text data to be sent to a reception device, and a reception language and a phone number of the reception device to generate a text data packet; (b2) transmitting the text data packet to the server for analyzing the text data to generate a sign recognition image recognizable by the reception device; and (b3) receiving the sign recognition image from the server, and displaying the sign recognition image on the reception device. - View Dependent Claims (9, 10, 11, 12, 13)
-
-
14. A storage medium having stored thereon instructions that, when executed by a processor of a mobile device, cause the mobile device to perform a method for recognizing sign language, the method comprising:
-
generating and displaying a main menu interface on the display screen, the main menu interface comprising an image recognition icon and a text recognition icon; determining whether the image recognition icon or the text recognition icon is selected; in response to the image recognition icon being selected, executing block (a1) to block (a5); (a1) controlling the image capturing unit to capture a gesture image of a target person; (a2) extracting sign language data from the gesture image according to body language of the target person; (a3) packing the sign language data and a preset language of the mobile device to generate a sign data packet; (a4) transmitting the sign data packet to a server for analyzing the sign language data to generate sign recognition information; and (a5) receiving the sign recognition information from the server, and displaying the sign recognition information in format of the preset language on the display screen; in response to the text recognition icon being selected, executing block (b1) to block (b3); (b1) packing text data to be sent to a reception device, and a reception language and a phone number of the reception device to generate a text data packet; (b2) transmitting the text data packet to the server for analyzing the text data to generate a sign recognition image recognizable by the reception device; and (b3) receiving the sign recognition image from the server, and displaying the sign recognition image on the reception device. - View Dependent Claims (15, 16, 17, 18, 19)
-
Specification