SPEECH GENERATION DEVICE WITH A PROJECTED DISPLAY AND OPTICAL INPUTS

• US 20120035934A1
• Filed: 08/03/2011
• Published: 02/09/2012
• Est. Priority Date: 08/06/2010
• Status: Active Grant

• Current Assignee: Tobii Dynavox AB
• Original Assignee: Tobii Dynavox LLC (Tobii Technology AB)
• Inventors: CUNNINGHAM, BOB
• Granted Patent: US 9,760,123 B2
• Time in Patent Office: Days
• US Class Current: 704/260
• CPC Class Codes: G06F 1/1639 the display being based on projection
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

In several embodiments, a speech generation device is disclosed. The speech generation device may generally include a projector configured to project images in the form of a projected display onto a projection Surface, an optical input device configured to detect an input directed towards the projected display and a speaker configured to generate an audio output. In addition, the speech generation device may include a processing unit communicatively coupled to the projector, the optical input device and the speaker. The processing unit may include a processor and related computer readable medium configured to store instructions executable by the processor, wherein the instructions stored on the computer readable medium configure the speech generation device to generate text-to-speech output.

Claims

1. A speech generation device, comprising

a projector configured to project images in the form of a projected display onto a projection surface;

an optical input device configured to detect an input directed towards the projected display;

a speaker configured to generate an audio output; and

a processing unit communicatively coupled to the projector, the optical input device and the speaker, the processing unit including a processor and a related computer readable medium configured to store instructions executable by the processor,

wherein the instructions stored on the computer readable medium configure the speech generation device to generate text-to-speech output.

2. The speech generation device of claim 1, wherein the optical input device is configured to detect an input object directed towards the projected display.

3. The speech generation device of claim 2, wherein the instructions stored on the computer readable medium configure the processing unit to determine at least one of a location and movement of the input object relative to the projected display.

4. The speech generation device of claim 3, wherein the instructions stored on the computer readable medium further configure the processing unit to recognize the at least one of the location and the movement of the input object relative to the projected display as a user input.

5. The speech generation device of claim 3, wherein the instructions stored on the computer readable medium configure the processing unit to determine the at least one of the location and the movement of the input object relative to the projected display using a video based system.

6. The speech generation device of claim 5, wherein the optical input device comprises at least one camera configured to capture an image of the input object relative to the projected display.

7. The speech generation device of claim 3, wherein the instructions stored on the computer readable medium configure the processing unit to determine the at least one of the location and the movement of the input object relative to the projected display using a thermal imaging system.

8. The speech generation device of claim 7, wherein the optical input device comprises a thermal imaging sensor configured to detect heat generated by the input object.

9. The speech generation device of claim 1, wherein the optical input device is further configured to capture an image of a user'"'"'s hand, wherein the instructions stored on the computer readable medium configure the processing unit to recognize hand gestures performed by the user as user inputs.

10. The speech generation device of claim 1, further comprising a housing, the projector, the optical input device and the processing unit being attached to or disposed within the housing.

11. A speech generation device, comprising

a first housing configured to be attached to a user;

a projector attached to or disposed within the first housing, the projector being configured to project images in the form of a projected display onto a projection surface;

an optical input device attached to or disposed within the first housing, the optical input device being configured to detect an input directed towards the projected display;

a speaker configured to generate an audio output; and

a processing unit communicatively coupled to the projector, the optical input device and the speaker, the processing unit including a processor and a related computer readable medium configured to store instructions executable by the processor,

wherein the instructions stored on the computer readable medium configure the speech generation device to generate text-to-speech output.

12. The speech generation device of claim 11, wherein an orientation of the optical input device within the first housing is fixed relative to an orientation of the projector within the first housing.

13. The speech generation device of claim 11, wherein the first housing is configured to be worn around a user'"'"'s neck.

14. The speech generation device of claim 11, further comprising a second housing located separate from the first housing, the processing unit being disposed within or attached to the second housing.

15. The speech generation device of claim 14, wherein the speaker is disposed within or attached to the first housing or the second housing.

16. A system for generating text-to-speech output for a user of a wheelchair, the system comprising:

a projector coupled to a portion of the wheelchair, the projector being configured to project images in the form of a projected display onto a projection surface;

an optical input device configured to detect an input directed towards the projected display;

a speaker configured to generate an audio output; and

a processing unit communicatively coupled to the projector, the optical input device and the speaker, the processing unit including a processor and a related computer readable medium configured to store instructions executable by the processor,

wherein the instructions stored on the computer readable medium configure the speech generation device to generate text-to-speech output.

17. The system of claim 16, further comprising a housing attached to a portion of the wheelchair, the projector being disposed within or attached to the housing.

18. The system of claim 17, wherein the optical input device is attached to or disposed within the housing.

19. The system of claim 17, wherein the housing is attached to an armrest of the wheelchair.

20. The system of claim 16, wherein the projection surface is defined on a lap tray.