INTELLIGENT EYEWEAR AND CONTROL METHOD THEREOF

• US 20150379896A1
• Filed: 06/30/2014
• Published: 12/31/2015
• Est. Priority Date: 12/05/2013
• Status: Abandoned Application

• Current Assignee: Beijing BOE Optoelectronics Technology Co Ltd. (BOE Technology Group Co., Ltd.), BOE Technology Group Co., Ltd.
• Original Assignee: Beijing BOE Optoelectronics Technology Co Ltd. (BOE Technology Group Co., Ltd.), BOE Technology Group Co., Ltd.
• Inventors: Yang, Jiuxia, Bai, Feng, Bai, Bing
• Application Number:
  US14/417,440
• Publication Number:
  US 20150379896A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: G09B 21/04 Devices for conversing with the deaf-blind
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2021/065 Aids for the handicapped in understanding

Abstract

An intelligent eyewear and a control method thereof are provided, and the intelligent eyewear includes an eyeglass, an eyeglass frame and a leg. The eyeglass includes a transparent display device for two-side display; the eyeglass frame is provided with a camera and an acoustic pickup, which are configured to acquire a gesture instruction and a voice signal respectively; and the leg is provided with a brainwave recognizer and a processor, the brainwave recognizer is configured to acquire a brainwave signal, and the processor is configured to receive and process the gesture instruction, the voice signal and the brainwave signal. The intelligent eyewear can convert information from outside into graphic and textual information visible to a wearer of the eyewear, and can further present what the wearer is not able to express in voice to others by means of graph and text.

Claims

1. An intelligent eyewear comprising an eyeglass, an eyeglass frame, and a leg;

wherein the eyeglass comprises a transparent display device configured to perform two-side display;

the eyeglass frame is provided with a camera and an acoustic pickup, which are configured to acquire a gesture instruction and a voice signal and convert them into a gesture signal and an audio signal respectively; and

the leg is provided with a brainwave recognizer and a processor, the brainwave recognizer is configured to acquire a brainwave signal of a wearer, and the processor is configured to receive and process the gesture signal, the audio signal and the brainwave signal and send a processed result to the transparent display device for the two-side display.

2. The intelligent eyewear of claim 1, wherein the processor is configured to generate the processed result in a form of graphic and textual information.

3. The intelligent eyewear of claim 1, wherein for each eyeglass, the transparent display device comprises a display device with two display surfaces, which are configured for front-face display and back-face display respectively.

4. The intelligent eyewear of claim 1, wherein for each eyeglass, the transparent display device comprises two display devices, each of which comprises one display surface, and the two display devices are configured for front-face display and back-face display respectively.

5. The intelligent eyewear of claim 1, wherein the transparent display device comprises a flexible display device.

6. The intelligent eyewear of claim 1, further comprising an analysis memory which is connected with the processor and has at least one of following databases stored therein:

a database comprising a correspondence relationship between the brainwave signal and content indicated by the brainwave signal, a database comprising a correspondence relationship between the gesture instruction and content indicated by the gesture instruction, and a database comprising a correspondence relationship between the voice signal and content indicated by the voice signal.

7. The intelligent eyewear of claim 1, further comprising a positioning system, wherein the camera is further configured to acquire environmental information of surroundings of the intelligent eyewear and send the environmental information to the processor, and the processor is further configured to determine a current location according to the environmental information the camera sends in combination with the positioning system.

8. The intelligent eyewear of claim 1, wherein the acoustic pickup is disposed at a position where a nose pad of the eyeglass frame is located, the brainwave recognizer is disposed in a middle of the leg, and the processor is disposed at a tail end of the leg.

9. The intelligent eyewear of claim 7, wherein the positioning system comprises a distance meter disposed on the leg and configured to sense a distance between the current location and a target location and send sensed data to the processor.

10. The intelligent eyewear of any claim 1, wherein the leg is further provided with a charging device, which is configured for charging at least one of the transparent display device, the camera, the acoustic pickup, the brainwave recognizer and the processor.

11. The intelligent eyewear of claim 10, wherein the charging device comprises a solar charging device which is integrated on a surface of the transparent display device.

12. The intelligent eyewear of claim 9, wherein the distance meter is one selected from the group consisting of an ultrasonic range finder, an infrared distancer and a laser range finder.

13. A control method for an intelligent eyewear, wherein the intelligent eyewear comprises an eyeglass, an eyeglass frame and a leg;

the eyeglass comprises a transparent display device configured to perform two-side display;

the eyeglass frame is provided with a camera and an acoustic pickup, which are configured to acquire a gesture instruction and a voice signal and convert them into a gesture signal and an audio signal respectively; and

the leg is provided with a brainwave recognizer and a processor, the brainwave recognizer is configured to acquire a brainwave signal of a wearer, and the processor is configured to receive and process the gesture signal, the audio signal and the brainwave signal and send a processed result to the transparent display device for the two-side display; and

the control method comprises a receiving mode and an expression mode which are configured to be performed one after another, simultaneously or independently, wherein the receiving mode comprises;

S1.1 by means of the camera and the acoustic pickup, acquiring the gesture instruction and the voice signal of a communicatee, converting the gesture instruction and the voice signal into the gesture signal and the audio signal and sending the gesture signal and the audio signal to the processor; and

S1.2 by means of the processor, recognizing and reading the audio signal and the gesture signal separately to convert the audio signal and the gesture signal into graphic and textual information, and performing back-face display through the eyeglass to display the information to the wearer; and

the expression mode comprises;

S2.1 by means of the brainwave recognizer, acquiring the brainwave signal of the wearer, obtaining a first information by encoding and decoding the brainwave signal, and sending the first information to the processor; and

S2.2 by means of the processor, converting the first information into graphic and textual information, and performing front-face display through the eyeglass to display the graphic and the textual information to the communicatee.

14. The control method of claim 13, wherein the step S1.2 comprises:

by means of the processor, performing searching and matching of the received gesture and audio signals in a database with a correspondence relationship between the gesture signal and content indicated by the gesture signal stored therein and in a database with a correspondence relationship between the audio signal and content indicated by the audio signal stored therein, and outputting indicated contents in a form of graph and text.

15. The control method of claim 13, wherein if the step S2.1 fails to acquire the brainwave signal, the method further comprises:

reminding an occurrence of an error through the back-face display of the eyeglass.

16. The control method of claim 13, wherein the step S2.2 comprises:

by means of the processor, performing searching and matching of the received first information in a database with a correspondence relationship between the brainwave information and content indicated by the brainwave information stored therein, and outputting indicated content in a form of graph and text.

17. The control method of claim 13, wherein before performing the front-face display, the step S2.2 further comprises:

performing back-face display for the graphic and textual information, and then performing the front-face display for the graphic and textual information after receiving a brainwave signal indicating acknowledgement from the wearer.

18. The control method of claim 13, in the step S1.1, the audio signal is obtained by performing analog-to-digital conversion for the acquired voice signal through the acoustic pickup.

19. The control method of claim 13, wherein in the step S1.1, information of an ambient environment for the intelligent eyewear is also acquired by the camera at a same time as the gesture signal and the audio signal are acquired, and is used to determine a current location in combination with a positioning system connected with the processor.

20. The control method of claim 19, wherein calculation of and comparison between the information of the ambient environment acquired by the camera and location information stored in the positioning system are performed by the processor.