METHOD AND DEVICE FOR HELPING TO UNDERSTAND AN AUDITORY SENSORY MESSAGE BY TRANSFORMING IT INTO A VISUAL MESSAGE

• US 20170018281A1
• Filed: 08/19/2015
• Published: 01/19/2017
• Est. Priority Date: 07/15/2015
• Status: Abandoned Application

• Current Assignee: Patrick Cosson
• Original Assignee: Patrick Cosson
• Inventors: COSSON, Patrick
• Application Number:
  US14/829,763
• Publication Number:
  US 20170018281A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0158 with adjustable nose pad
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2021/065 Aids for the handicapped in understanding
• CPC Class Codes: G10L 21/10 Transforming into visible information

Abstract

A method and a device for helping a hearing-impaired person to understand an auditory sensory message by transforming the auditory message into a visual message and projecting this message on a support in the field of vision of the hearing-impaired person. This device comprises a support (11) carrying a sensor in the form of microphones (16, 17) to pick up the message, recording and memorizing module (19) for recording and memorizing/storing in real time the auditory message, and transforming the message into a visual message. A screen (18) is placed in the field of vision of the user, and at least one projector (20, 21) projects the visual message on the screen. A sensor detects pupil movement of the user and mechanism converts pupil movement of the user into a display command for the visual message, and carrying out the command by projecting the visual message.

Claims

1-15. -15. (canceled)

16. A method for helping a hearing-impaired person called a user to understand an auditory sensory message by transforming the auditory sensory message into a visual message and projecting the visual message on a surface positioned in a field of vision of the user, the method comprising:

picking up the auditory sensory message by at least one sensor mounted on a support of a spectacle or equivalent component,

recording the auditory message in real time to allow re-using the recorded auditory message in deferred time,

transforming the auditory sensory message into a visual message,

projecting the visual message, following a user command, on a screen integral with the support of the spectacle or equivalent component placed in the field of vision of the user,

carrying out the command by at least one pupil movement of the user, and

performing the projection of the visual message in a static or scrolling way, one single time or repeatedly, immediately or with a delay, depending on the user command that is picked up by a member detecting the pupil movement.

17. The method for helping the hearing-impaired person according to claim 16, further comprising carrying the projection of the visual message out on at least two display lines, with the first line being assigned to the display of the visual transcription of the auditory message, and the second line being assigned to additional information useful for the comprehension of the message.

18. The method for helping the hearing-impaired person according to claim 17, further comprising translation the additional information, useful for the comprehension of the message, into a language selected by the user.

19. The method for helping the hearing-impaired person according to claim 17, further comprising carrying out the projection of the visual message with a predetermined lag with respect to communication of the auditory message.

20. A device (10) implementing the method for helping a hearing-impaired person called a user to understand an auditory sensory message, the device including means for transforming the auditory sensory message into a visual message and means for projecting the visual message on a surface positioned in a field of vision of the user, wherein the device comprises:

a support (11) arranged to carry the set of functional elements involved in the fulfillment of the functions of the method, the set of functional elements comprising;

at least one sensor (16, 17) mounted on the support and arranged to pick up the auditory sensory message,

recording and memorizing means (19a, 19′

a) for recording and memorizing the auditory message in real time,

transformation means (19b, 19′

b) for transforming the auditory sensory message into a visual message,

a screen (18) integral with the support (11) and placed in the field of vision of the user,

at least one element (20, 21) for projecting the visual message on the screen of the support,

at least one sensor (25, 26) for sensing pupil movement of the user,

means (19c, 19′

c) for converting the pupil movement of the user into a display command for the visual message, and

means (19d, 19′

d) for carrying out the command by projecting the visual message in a static or a scrolling way, one single time or repeatedly, immediately or with a delay.

21. The device according to claim 20, wherein the support is of a spectacle or equivalent component and comprises a front bar (12) with a bridge (13), and the front bar carrying two temples (14, 15) articulated at the ends of the front bar (12).

22. The device according to claim 21, wherein the at least one element to project the visual message includes two projectors (20, 21) respectively mounted on the temples (14, 15), each of the projectors is arranged so as to project at least a part of the visual message corresponding to the auditory sensory message.

23. The device according to claim 20, wherein the device comprises means (25, 26) for picking up at least one pupil movement of the user, means for interpreting the at least one pupil movement and means for carrying out a command for projecting the visual message according to the interpretation of the pupil movement.

24. The device according to claim 22, wherein the means (19d, 19′

d) for carrying out a command for projecting the visual message is coupled with the two projectors (20, 21) arranged to project at least a part of the visual message.

25. The device according to claim 20, wherein the at least one sensor arranged, for picking up the auditory sensory message, is a directional microphone (20, 21) mounted on the front section of the support.

26. The device according to claim 20, wherein the device includes an electronic unit (19) powered by an electrical power source (22), the electronic circuit comprising a first memorization module (19a) arranged to memorize temporarily and in real time the auditory sensory message, a second transcription module (19b) arranged to transcribe the auditory message into visual data, a third control module (19c) arranged for receiving and interpreting the pupillary command message and working out the corresponding visual message, and a fourth display triggering module (19d) arranged for carrying out the display of the message according to the pupillary command.

27. The device according to claim 26, wherein at least one of the first memorization module (19a), the second transcription module (19b), the third control module (19c) and the fourth display triggering module (19d) of the electronic circuit (19) is arranged remotely from the support of device (10) and comprises means (30, 31) for transmitting and receiving information to and from a device-external equipment.

28. The device according to claim 21, wherein the device comprises a display device (18) mounted on the front bar arranged for displaying the visual message in the form of a signal made of at least one of words, written phrases and informative acronyms.

29. The device according to claim 26, wherein the display device comprises a screen (18) including at least two lines (18a, 18b) arranged for displaying the visual message in a static or scrolling way, one single time or repeatedly, immediately or with a delay.

30. The device according to claim 26, wherein the device is connectable, through the electronic unit (19), with any external device having a suitable connection for receiving an auditory signal to be processed is a similar way and procedure as a signal provided by microphones (16, 17).

31. The device according to claim 30, wherein the device is connectable through a “

Bluetooth”

transceiver type electronic unit (19).