COLLABORATIVE AUGMENTATIVE AND ALTERNATIVE COMMUNICATION SYSTEM

• US 20110257977A1
• Filed: 06/29/2011
• Published: 10/20/2011
• Est. Priority Date: 08/03/2010
• Status: Abandoned Application

• Current Assignee: Assistyx LLC
• Original Assignee: Assistyx LLC
• Inventors: Greenberg, Leonard A., Bookman, Philip G.
• Application Number:
  US13/171,866
• Publication Number:
  US 20110257977A1
• Time in Patent Office: Days
• US Class Current: 704/271
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

A system and method for presenting and editing associations between graphics and audio useful for assisting people who have difficulty in speaking. This may include presenting graphics and audio information together with topic information thus allowing for a user to create outlines of speech needed for different events and situations. When a user selects a topic, images appear and by selecting the image a device is instructed to play the associated audio file. Images and audio may be outlined into useful constructs to provide for differing situations and multiple users may edit those outlines. Moreover, the constructs, may be published to devices and other systems. In accordance with certain embodiments, images and audio files may be uploaded or purchased from vendors. Collaboration provides the speech impaired with the ability to develop a progressively improving speech vocabulary and to share that vocabulary with others needing assistance.

Claims

1. A method including:

presenting picture object information, said picture object including at least a graphic and an audio file;

presenting topic selection information;

receiving topic information in response to said presenting;

associating the picture object with the topic, and

publishing the picture object and the topic, said publishing including

presenting the picture object and the topic to a plurality of users.

2. The system of claim 1 wherein publishing further includes:

receiving commands operable to play the audio file through a speaker in response to a user selecting the picture object.

3. The system of claim 2 wherein the publishing further includes:

displaying a different topic in response to said commands.

4. The system of claim 1 further including:

receiving a graphic, said receiving including either uploading a graphic file, selecting a graphic from a list provided by a vendor, or selecting one from a list of previously stored graphic files.

5. The system of claim 1 further including:

receiving an audio file, said receiving including either uploading an audio file, selecting an audio file from a list provided by a vendor, or selecting one from a list of previously stored audio files.

6. A system including:

a display engine, said display engine operative to;

receive a graphic;

receive an audio file;

associate said graphic and file to a topic, and

an execution engine, said execution engine operable to;

persist the graphic, file and topic in memory, and

publish the graphic, file and topic.

7. The system of claim 6 wherein the audio file represents an element of human speech and the graphic is identified with the human speech.

8. The system of claim 6 wherein receive a graphic includes either uploading a graphic file, selecting a graphic from a list provided by a vendor, or selecting one from a list of previously stored graphic files.

9. The system of claim 6 wherein receiving an audio file includes either uploading an audio file, selecting an audio file from a list provided by a vendor, or selecting one from a list of previously stored audio files.

10. The system of claim 6 wherein publishing includes downloading to a mobile device, said mobile device including a display and a speaker,

wherein when a user selects the graphic, the audio file plays.

11. The system of claim 6 wherein the display engine is further operable to:

associate second graphics and second audio files with one or more topics; and

associate the second topics to the topic; and

the execution engine is further operable to display the one or more second topics in response to a user selecting the topic.

12. The system of claim 6 wherein publishing includes presenting a browser window, said browser window including controls to select the graphic, and in response to said selecting, edit the graphic or the audio file.

13. The system of claim 6 wherein the topic is an event or situation.

14. The system of claim 6 wherein the display engine is further operable to:

associate a second graphic and a second audio file with the topic.

15. A method comprising:

receiving a plurality of graphics and audio files, each of said graphics associated with an audio file and a topic;

receiving outline information, said outline associating the graphics and audio files with events or situations, and

publishing the outline, graphics and audio files.

16. The method of claim 15 wherein said receiving outline information includes:

presenting an outline to a user;

receiving alternative outline information from the user, and

altering the outline in response to the alternative outline information.

17. The method of claim 15 wherein publishing the outline includes:

transferring the outline to a remote device,

wherein a user selects a topic and an image and the audio file plays.

18. The method of claim 17 wherein further including:

changing the topic in response to said user'"'"'s selection.

19. The method of claim 15 wherein publishing the outline includes:

transferring the outline, image and audio file to a server, said server includes program instructions operable to edit the outline,

wherein multiple users having access to said server may edit the outline.

20. The method of claim 15 wherein the topic relates to an event or situation and the audio file represents a human voice.