Method and apparatus to individualize content in an augmentative and alternative communication device

• US 20060257827A1
• Filed: 03/20/2006
• Published: 11/16/2006
• Est. Priority Date: 05/12/2005
• Status: Abandoned Application

• Current Assignee: Blink-Twice LLC
• Original Assignee: Blink-Twice LLC
• Inventors: Ellenson, Richard
• Application Number:
  US11/378,633
• Publication Number:
  US 20060257827A1
• Time in Patent Office: Days
• US Class Current: 434/112
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser
• CPC Class Codes: G10L 2021/0135 Voice conversion or morphing
• CPC Class Codes: G10L 21/0264 characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques

Abstract

An assistive communication apparatus which facilitates communication between a linguistically impaired user and others, wherein the apparatus comprises a display capable of presenting a plurality of graphical user interface elements; a camera which can record at least one image when operated by a user; at least one data storage device, the at least one data storage device capable of storing at least one image recorded from the camera, a plurality of auditory representations, and associations between at least one of the images recorded from the camera and at least one of the auditory representations; at least one processor which causes at least one image recorded from the camera which to be presented in the display.

Claims

1. A method for communicating using a communication device, the method comprising the steps of:

selecting a display location for an image, the display location being associated with a specific resolution and a specific aspect ratio;

acquiring the image in the specific resolution and the specific aspect ratio;

acquiring an auditory representation related to the image;

associating the image with the auditory representation;

defining an alteration for the auditory representation; and

accessing the image in the display location thereby causing output of an altered auditory representation.

2. The method of claim 1 wherein the step of selecting is performed prior to the step of acquiring the image.

3. The method of claim 2 wherein the image includes a pictorial representation of a lingual element for use in the communication device, and the auditory representation comprises an auditory representation of the lingual element.

4. The method of claim 3 wherein the display location is a location within a lingual communication hierarchy.

5. The method of claim 1 wherein the step of selecting is performed subsequent to the step of acquiring the image.

6. The method of claim 1, further comprising the steps of:

selecting a second display location for a second image, the second display location being associated with the specific resolution and the specific aspect ratio;

acquiring the second image in the specific resolution and the specific aspect ratio;

acquiring a second auditory representation related to the second image;

associating the second image with the second auditory representation;

defining a second alteration for the second auditory representation; and

accessing the second image in the second display location thereby causing output of a second altered auditory representation.

7. The method of claim 6 wherein the second alteration is the same as the first alteration.

8. The method of claim 7 wherein the first display location and the second display locations are associated with a story.

9. An assistive communication apparatus, the apparatus facilitating communication between a communicatively challenged user and others, comprising:

a display, wherein the display is capable of presenting a plurality of graphical user interface elements;

a camera, wherein the camera records at least one image when triggered by a user;

at least one data storage device, wherein the at least one data storage device stores at least one image recorded from the camera and a plurality of auditory representations, and wherein the data storage device further stores associations between the at least one image recorded from the camera and at least one of the plurality of auditory representations;

at least one processor, for displaying as a graphical user interface element in the display the at least one image recorded from the camera.

10. The apparatus of claim 9, further comprising:

an auditory output device, wherein the auditory output device is capable of outputting the auditory representations stored on the at least one data storage device.

11. The apparatus of claim 10, wherein the audio output device is a speaker.

12. The apparatus of claim 10, wherein the audio output device is a headset jack.

13. The apparatus of claim 10, wherein the audio output device is an external device interface.

14. The apparatus of claim 13, wherein the external device interface allows the audio output device to output the auditory representations of linguistic elements as text.

15. The apparatus of claim 13, wherein at least a portion of the text is output in an instant message.

16. The apparatus of claim 13, wherein at least a portion of the text is output in an E-mail.

17. The apparatus of claim 9, wherein the camera is communicatively coupled to the apparatus.

18. The apparatus of claim 9, wherein at least one of the plurality of auditory representations includes recorded speech.

19. The apparatus of claim 18, wherein the at least one processor allows the user to modify tonal characteristics of the recorded speech.

20. The method of claim 19, wherein the tonal modifications include at least one of the pitch, tempo, rate, equalization, and reverberation of the recorded speech.

21. The method of claim 19, wherein the tonal modifications include modifying the perceived gender of the speaker.

22. The method of claim 19, wherein the tonal modifications include modifying the perceived age of the speaker.

23. The apparatus of claim 9, wherein the at least one processor allows the user to associate a plurality of the at least one recorded images to create a story.

24. The apparatus of claim 23, wherein the display presents the story as a plurality of concurrently presented images

25. The apparatus of claim 24, wherein the display allows the user to select at least one of the concurrently presented images, and wherein the processor causes the at least one auditory representation associated with the selected at least one of the concurrently presented images to be played back.

26. The apparatus of claim 23, wherein each image captured by the camera is stored in a default photo album unless an alternative photo album is chosen by the user.

27. The apparatus of claim 26, wherein each subsequent image captured by the camera is stored by default in the same photo album as the previous image unless an alternative photo album is chosen by the user.

28. The apparatus of claim 9, further comprising a microphone, wherein the microphone records speech when triggered by the at least one user.

29. The apparatus of claim 28, wherein the speech is stored on the data storage device such that the at least one sound functions as an auditory representation.

30. The apparatus of claim 9, wherein the at least one image recorded by the camera is the appropriate aspect ratio for the user interface element in which the picture will be displayed.

31. The apparatus of claim 30, wherein all user interface elements utilize the same aspect ratio.

32. A method for adapting a device, comprising:

receiving from a user an instruction to capture at least one image using a camera communicatively coupled to the device;

receiving from the user at least one instruction to associate the captured at least one image with a user-actionable user interface element on the device;

associating the user-actionable user interface element with an auditory representation stored on the device, wherein activation of the user-actionable user interface element triggers presentation of the associated auditory representation; and

,

displaying the associated at least one image as part of the user interface element.

33. The method of claim 32, wherein the user-actionable user interface element is a button.

34. The method of claim 32, further comprising playing the associated recording when the user-actionable user interface element is triggered by the user.

35. The method of claim 32, further comprising receiving from the user at least one instruction to associate a plurality of the captured images with a story.

36. The method of claim 35, further comprising displaying at least part of the story as a plurality of images selected from the plurality of the captured images associated with the story.

37. The method of claim 36, wherein selection of one of the displayed images causes all of the at least one sounds associated with the story to be sequentially played.

38. The method of claim 32, further comprising receiving from the user at least one instruction to associate a plurality of the captured images with a set of instructions.

39. The method of claim 32, further comprising receiving from the user at least one instruction to associate a plurality of the captured images with a photo album.

40. The method of claim 32, wherein the auditory representation is a recording.

41. The method of claim 32, wherein the auditory representation is stored as information representative of the auditory representation.

42. The method of claim 41, wherein the information representative of the auditory representation is text.

43. The method of claim 42, further comprising outputting the text via a text to speech algorithm.

44. The method of claim 42, further comprising outputting the text as at least a portion of an instant message.

45. The method of claim 42, further comprising outputting the text as at least a portion of an E-mail.

46. The method of claim 32, further comprising allowing a user to modify the tonal characteristics of an auditory representation stored on the device.

47. The method of claim 46, wherein the tonal modifications include at least one of the pitch, tempo, rate, equalization, and reverberation of the auditory representation.

48. The method of claim 46, wherein the tonal modifications include modifying the perceived age of a speaker of the auditory representation.

49. The method of claim 46, wherein the tonal modifications include modifying the perceived gender of a speaker of the auditory representation.

50. The method of claim 32, wherein the aspect ratio of the captured at least one image is equal to that of a standard user interface element for the device.

51. The method of claim 32, wherein the aspect ratio of the captured at least one image is equal to that of the user interface element in which the image is to be displayed.

52. An assistive communication apparatus, comprising:

a data storage device, wherein at least one audio recording is stored on the data storage device;

a processor, wherein the processor can utilize at least one of a set of algorithms to modify an audio recording to change perceived attributes of the recording;

a display, wherein the display can allow a user to select from the at least one audio recordings stored on the data storage device and the set of algorithms, thereby causing the audio recording to be modified; and

an audio output device, wherein the audio output device outputs the modified audio recording.

53. The assistive communication apparatus of claim 52, wherein the set of algorithms includes an algorithm for changing the emotional expression of the audio recording.

54. The assistive communication apparatus of claim 52, wherein the set of algorithms includes an algorithm for simulating shouting of the audio recording.

55. The assistive communication apparatus of claim 52, wherein the set of algorithms includes an algorithm for simulating whispering of the audio recording.

56. The assistive communication apparatus of claim 52, wherein the set of algorithms includes an algorithm for simulating whining of the audio recording.

57. The assistive communication apparatus of claim 52, wherein the set of algorithms includes an algorithm for altering the perceived age of the speaker in the audio recording.

58. The assistive communication apparatus of claim 52, wherein the set of algorithms includes an algorithm for altering the perceived gender of the speaker in the audio recording.

59. The assistive communication apparatus of claim 52, wherein the processor can apply the algorithms in real time.

60. The assistive communication apparatus of claim 52, wherein the algorithms are applied to the audio recording prior to a desired presentation time.

61. A method for adding content to a communication device, the method comprising the steps of:

selecting a display location for an image, the display location being associated with a specific resolution and a specific aspect ratio;

acquiring the image in the specific resolution and the specific aspect ratio;

acquiring an auditory representation related to the image;

associating the image with the auditory representation;

defining an alteration for the auditory representation; and

associating the alteration with the auditory representation in a manner that will cause an output of the auditory representation to be altered.

62. A method for telling a story to a recipient using a communication device, the method comprising the steps of:

selecting a location for a first content element;

acquiring the first content element;

selecting a location for a second content element;

acquiring the second content element;

selecting a location for a third content element;

acquiring the third content element;

associating each of the first, second and third content elements with a first, second and third user interface element, respectively; and

accessing the first, second and third user interface elements in sequence;

wherein the accessing of a user interface element causes the content element to be conveyed to the recipient.

63. The method of claim 62, further comprising the steps of:

defining an alteration for an auditory representation; and

associating the alteration with the content elements in a manner that will cause an output of the content elements to be altered.

64. The method of claim 63, wherein the alteration defined is an alteration from an adult voice to a child voice.