System and method of controlling a graphical user interface at a wireless device

• US 20070204228A1
• Filed: 02/24/2006
• Published: 08/30/2007
• Est. Priority Date: 02/24/2006
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Minear, Brian
• Granted Patent: US 8,582,729 B2
• Time in Patent Office: Days
• US Class Current: 715/728
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 11/007 with remote control systems remote control in general G08C
• CPC Class Codes: H04M 2201/38 Displays
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2201/42 Graphical user interfaces
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 2203/254 where the visual mode comprises menus
• CPC Class Codes: H04M 2207/18 wireless networks
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
• CPC Class Codes: H04M 7/0093 signalling arrangements in networks
• CPC Class Codes: H04W 4/00 Services specially adapted for wireless communication networks; Facilities therefor
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

A method of controlling a graphical user interface (GUI) at a wireless device is disclosed and includes storing a set of audio GUI controls at an interactive voice response server and creating an audio GUI control string that is to be communicated to the wireless device within a voice stream. The audio GUI control string corresponds to a text string that is selectably presentable at the wireless device. Further, the method can include embedding the audio GUI control string within the voice stream. Additionally, the method can include transmitting the voice stream with the embedded audio GUI control string to the wireless device.

Claims

1. A method of controlling a graphical user interface (GUI) at a wireless device, the method comprising:

storing a set of audio GUI controls at an interactive voice response server; and

creating an audio GUI control string to be communicated to the wireless device within a voice stream, wherein the audio GUI control string corresponds to a text string selectably presentable at the wireless device.

2. The method of claim 1, further comprising embedding the audio GUI control string within the voice stream.

3. The method of claim 2, further comprising receiving a call from the wireless device.

4. The method of claim 3, further comprising transmitting the voice stream with the embedded audio GUI control string to the wireless device.

5. The method of claim 1, wherein the set of audio GUI controls includes a plurality of signals, each at a different one of a plurality of selectively audio frequencies and each of the plurality of signals correspond to a different GUI control at the wireless device.

6. The method of claim 5, wherein the plurality of selectively audio frequencies includes twenty-six different frequencies and each of the twenty six different frequencies corresponds to a unique alphabetical character displayable at the wireless device.

7. The method of claim 6, wherein the plurality of selectively audio frequencies further includes ten different frequencies and each of the ten different frequencies corresponds to a unique numerical character displayable at the wireless device.

8. A method of controlling a user interface at a wireless device, the method comprising:

creating an audio GUI control string to be embedded within a voice stream, wherein the audio GUI control string corresponds to a text string that is presentable at the user interface at the wireless device; and

embedding the audio GUI control string within the voice stream.

9. The method of claim 8, further comprising:

receiving a call from the wireless device; and

determining whether the wireless device is controllable via the set of audio GUI controls.

10. The method of claim 9, further comprising transmitting a voice stream other than the voice stream with an embedded audio GUI control string after determining that the wireless device is not controllable via the audio GUI controls.

11. The method of claim 10, further comprising transmitting the voice stream with an embedded audio GUI control string after determining that the wireless device is controllable via the set of audio GUI controls.

12. The method of claim 11, further comprising transmitting a set of audio GUI control definitions to the wireless device prior to transmitting the voice stream with the embedded audio GUI control string.

13. A method of communicating with an interactive voice response server, the method comprising:

receiving a voice stream; and

determining whether an audio GUI control string is embedded within the voice stream.

14. The method of claim 13, wherein the voice stream is received from an interactive voice response server.

15. The method of claim 13, further comprising decoding the audio GUI control string.

16. The method of claim 15, further comprising applying the audio GUI control string to a GUI at the wireless device.

17. The method of claim 16, further comprising decoding voice data within the voice stream.

18. The method of claim 17, further comprising transmitting decoded voice data via a speaker.

19. A method of communicating with an interactive voice response server, the method comprising:

receiving a query from an interactive voice response server to determine whether a wireless device is controllable via audio GUI controls.

20. The method of claim 19, further comprising receiving a voice stream, wherein the voice stream includes an embedded audio GUI control string.

21. The method of claim 20, further comprising receiving audio GUI control definitions prior to receiving the voice stream with the embedded audio GUI control string.

22. The method of claim 20, further comprising decoding the audio GUI control string.

23. The method of claim 22, further comprising applying the audio GUI control string to a GUI at the wireless device.

24. The method of claim 23, further comprising decoding voice data from the voice stream.

25. The method of claim 24, further comprising transmitting decoded voice data via a speaker.

26. The method of claim 24, wherein the audio GUI control string causes the GUI within the wireless device to present a text string corresponding to the voice data.

27. A communication system, comprising:

an interactive voice response server remotely coupled to a wireless device, the interactive voice response server comprising;

a processor;

a computer readable medium accessible to the processor; and

a computer program embedded within the computer readable medium, the computer program comprising;

instructions to define a set of audio GUI controls;

instructions to store the set of audio GUI controls at the computer readable medium; and

instructions to create an audio GUI control string to be communicated to with voice data within a voice stream, wherein the audio GUI control string corresponds to a text string to be displayed at the wireless device.

28. A communication system, comprising:

an interactive voice response server to receive calls from a wireless device, the interactive voice response server comprising;

a processor;

a computer readable medium accessible to the processor; and

a computer program embedded within the computer readable medium, the computer program comprising;

instructions to create an audio GUI control string to be communicated to with voice data within a voice stream, wherein the audio GUI control string corresponds to a text string to be displayed at the wireless device; and

instructions to embed the audio GUI control string within the voice stream.

29. A wireless device, comprising:

a processor;

a display responsive to the processor;

a computer readable medium accessible to the processor; and

a computer program embedded within the computer readable medium, the computer program comprising;

instructions to present a GUI (GUI) at the display, wherein the GUI is controllable via one or more audio GUI controls received at the wireless device over a voice channel.

30. A wireless device, comprising:

a processor;

a computer readable medium accessible to the processor; and

a computer program embedded within the computer readable medium, the computer program comprising;

instructions to receive a query from an interactive voice response server to determine whether the wireless device is controllable via audio GUI controls.

31. A computer program embedded within a computer readable medium, the computer program comprising:

instructions to define a set of audio GUI controls;

instructions to store the set of audio GUI controls at an interactive voice response server; and

instructions to create an audio GUI control string that corresponds to voice data to be communicated over a voice stream, wherein the audio GUI control string corresponds to a text string selectively displayable at a wireless device.

32. A computer program embedded within a computer readable medium, the computer program comprising:

instructions to create an audio GUI control string that corresponds to voice data of a voice stream, wherein the audio GUI control string corresponds to a text string selectively displayable at a wireless device; and

instructions to embed the audio GUI control string within the voice stream.

33. A computer program embedded within a computer readable medium, the computer program comprising:

instructions to receive a voice stream; and

instructions to determine whether an audio GUI control string is embedded within the voice stream.

34. An interactive voice response server, comprising:

means for defining a set of audio GUI controls;

means for storing the set of audio GUI controls at an interactive voice response server; and

means for creating an audio GUI control string that corresponds to voice data within a voice stream, wherein the audio GUI control string corresponds to a text string selectively displayable at a wireless device.

35. An interactive voice response server, comprising:

means for creating an audio GUI control string that corresponds to voice data within a voice stream, wherein the audio GUI control string corresponds to a text string selectively displayable at a wireless device; and

means for embedding the audio GUI control string within the voice stream.

36. A wireless device, comprising:

means for receiving a voice stream; and

means for determining whether an audio GUI control string is embedded within the voice stream.

37. A wireless device, comprising:

means for receiving a query from the interactive voice response server to determine whether the wireless device is controllable via audio GUI controls.