Method and system for operating a multi-function portable electronic device using voice-activation

• US 8,977,255 B2
• Filed: 04/03/2007
• Issued: 03/10/2015
• Est. Priority Date: 04/03/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Freeman, Daniel, Barrentine, Derek B.
• Primary Examiner(s): Chang, Kent
• Assistant Examiner(s): WOO, KUO-KONG
• Application Number:
  US11/696,057
• Publication Number:
  US 20080248797A1
• Time in Patent Office: 2,898 Days
• Field of Search: 455/556.1, 455/569.1, 455/563, 455/151.4, 704/275, 704/270, 704/274, 704/201, 704/231, 700/94, 348/14.02
• US Class Current: 455/425
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04M 1/575 Means for retrieving and displaying personal data about calling party
• CPC Class Codes: H04M 1/6066 including a wireless connection
• CPC Class Codes: H04M 1/6075 adapted for handsfree use in a vehicle H04M1/6058 takes precedence; arrangements for holding telephones in a vehicle B60R11/0241
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72409 by interfacing with external accessories hands-free H04M1/60
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72433 for voice messaging, e.g. dictaphones for answering incoming calls H04M1/64
• CPC Class Codes: H04M 1/72442 for playing music files
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04W 52/0254 detecting a user operation or a tactile contact or a motion of the device
• CPC Class Codes: Y02D 30/70 in wireless communication networks

Abstract

Methods and systems in which a portable electronic device can be voice activated are disclosed. The portable electronic device can be a multi-function electronic device. The voice activation can be robust and context sensitive. The voice activation can also be utilized without any preparatory user action with respect to the portable electronic device. The portable electronic device can also interact with a media system.

Claims

1. A method for operating a portable electronic device using voice-activated input, the portable electronic device being operable in a plurality of different operational states, the method comprising:

operating the portable electronic device in a low power mode;

receiving a voice command while in the low power mode;

determining while in the lower power mode that the voice command is one of a set of voice commands authorized for usage while the portable electronic device is in the low power mode, and in response to determining that the voice command is one of the set of voice commands;

changing from the low power mode to a normal power mode; and

executing a function associated with the voice command once the portable electronic device is in the normal power mode.

2. A method as recited in claim 1, wherein one or more of the set of voice commands pertain to a macro, each of the macros including a plurality of commands.

3. A method as recited in claim 2, wherein when the executing operates to execute the determined one of the commands which is a macro, the plurality of commands of the macro are sequentially performed.

4. A method as recited in claim 1, wherein determining that the voice command is one of the commands within the set of voice commands comprises determining whether the voice command includes one of a set of key words or phrases that correspond to the set of voice commands.

5. A method as recited in claim 1, further comprising:

operating the portable electronic device in the normal power mode;

monitoring an operational state of the portable electronic device; and

determining, based on the operational state of the portable electronic device, a second set of voice commands that are authorized for usage with the portable electronic device while the portable electronic device is in the operational state, wherein the second set of commands differs based on the different operational states in which the portable electronic device can operate.

6. A method as recited in claim 5, wherein the operational state of the portable electronic device is a state of graphical user interface, and

wherein the second set of voice commands that are authorized for usage are dependent on the state of the graphical user interface.

7. A method as recited in claim 1, wherein said method further comprises:

displaying, on a display device associated with the portable electronic device, information pertaining to the set of voice commands.

8. A method as recited in claim 1, wherein the portable electronic device is a multi-function device supporting a plurality of functions, one of the functions being wireless voice communications and another of the functions being media playback.

9. A method as recited in claim 1, wherein the electronic device is a portable multi-function device that supports wireless voice communications and wherein the portable multi-function device can operatively connect, wirelessly or wired, with at least one other electronic device or system that supports media playback.

10. A method as recited in claim 9, wherein the voice command is executed on the at least one other electronic device or system.

11. A method as recited in claim 9, wherein the portable multi-function device is a handheld electronic device.

12. A portable electronic device operable in a plurality of operational states, the portable electronic device comprising a processor and memory storing one or more programs for execution by the processor, the one or more programs comprising instructions for:

operating the portable electronic device in a low power mode;

receiving a voice command from a user while in the low power mode;

determining while in the low power mode that the voice command is one of a set of voice commands authorized for usage while the portable electronic device is in the low power mode, and in response to determining that the voice command is one of the set of voice commands;

changing from the low power mode to a normal power mode; and

executing a function associated with the voice command once the portable electronic device is in the normal power mode.

13. A portable electronic device as recited in claim 12, wherein one or more of the set of voice commands pertain to a macro including at least a series of commands to be performed.

14. A portable electronic device as recited in claim 12, wherein the portable electronic device is a multi-function device supporting a plurality of functions, one of the functions being wireless voice communications and another of the functions being media playback or media recording.

15. A portable electronic device as recited in claim 12, wherein the portable electronic device is a handheld electronic device.

16. A portable electronic device as recited in claim 12, further comprising instructions for:

operating the portable electronic device in the normal power mode;

monitoring an operational state of the portable electronic device; and

determining, based on the operational state of the portable electronic device, a second set of voice commands that are authorized for usage with the portable electronic device while the portable electronic device is in the operational state, wherein the second set of commands differs based on the different operational states in which the portable electronic device can operate.

17. A portable electronic device as recited in claim 16, wherein the operational state of the portable electronic device is dependent on a state of an application program being executed by the processor.

18. A portable electronic device as recited in claim 16, wherein the portable electronic device includes a display device, and

wherein the operational state of the portable electronic device is dependent on a state of a graphical user interface provided on the display device.

19. A method for operating an electronic device supporting or coupling to a plurality of functions, one of the functions being wireless voice communications and another of the functions being media playback, said method comprising:

determining whether a voice call is incoming;

receiving a first voice command;

determining whether the first voice command corresponds to a request for caller information; and

in response to a determination that the first voice command corresponds to a request for caller information, presenting caller information to the user via an audio output.

20. A method as recited in claim 19, further comprising:

determining whether media playback is active;

outputting a ringtone if a voice call is incoming and media playback is not active;

outputting the ringtone mixed with media output of the media playback if a voice call is incoming and media playback is active;

receiving a second voice command;

determining whether the second voice command corresponds to a request to answer the call;

in response to a determination that the second voice command corresponds to a request to answer the call, answering the call; and

pausing or stopping the media playback if media playback is still active when the call is answered.

21. A method as recited in claim 20, wherein said method further comprises:

limiting the volume of the media output from a prior volume level if media playback is active and the voice call is incoming; and

returning the media output to the prior volume level after the call has ended.

22. A method as recited in claim 20, wherein said method further comprises:

deactivating the microphone after the call has ended.

23. A method as recited in claim 20, wherein after answering the call and before the call has ended, said method further comprises:

activating a microphone;

determining whether a third voice command is received while the call is ongoing; and

performing the third voice command that is received while the call is ongoing.

24. A method as recited in claim 23, wherein the third voice command is an end call command or a volume adjustment command.

25. A method as recited in claim 23, wherein said method further comprises:

limiting the volume of the media output from a prior volume level if media playback is active and a voice call is incoming; and

returning the media output to the prior volume level after the call has ended.

26. A method as recited in claim 25, wherein said method further comprises:

deactivating the microphone after the call has ended.

27. A method as recited in claim 20, further comprising:

determining whether the call has ended; and

resuming or restarting the media playback after the call has ended.

28. A method as recited in claim 20, further comprising:

while outputting the ringtone, presenting a plurality of voice command options to a user on a graphical user interface of an electronic device, wherein one of the plurality of voice command options is a call answer command.

29. A method as recited in claim 28, wherein a second of the plurality of voice command options is a send to voicemail command.

30. A method as recited in claim 19, wherein the electronic device is a portable multi-function device that supports both wireless voice communications and media playback.

31. A method as recited in claim 19, wherein the electronic device is a portable multi-function device that supports wireless voice communications and wherein the portable multi-function can operatively connect, wirelessly or wired, with another electronic device or system that supports media playback.

32. A method as recited in claim 31, wherein the another electronic device or system is an automobile stereo system.

33. A non-transitory computer readable medium including at least computer program code stored thereon for operating a portable electronic device using voice-activated input, the portable electronic device being operable in a plurality of different operational states, the computer readable medium comprising:

computer program code for operating the portable electronic device in a low power mode;

computer program code for receiving a voice command while in the low power mode;

computer program code for determining while in the low power mode that the voice command is one of a set of voice commands authorized for usage while the portable electronic device is in the low power mode, and in response to determining that the voice command is one of the set of voice commands;

changing from the low power mode to a normal power mode; and

executing a function associated with the voice command once the portable electronic device is in the normal power mode.

34. A non-transitory computer readable medium including at least computer program code stored thereon for operating an electronic device supporting or coupling to a plurality of functions, one of the functions being wireless voice communications and another of the functions being media playback, the computer readable medium comprising:

computer program code for determining whether a voice call is incoming;

computer program code for receiving a first voice command;

computer program code for determining whether the first voice command corresponds to a request for caller information; and

computer program code for, in response to a determination that the first voice command corresponds to a request for caller information, presenting caller information to the user via audio output.

35. The non-transitory computer readable medium of claim 34, further comprising:

computer program code for determining whether media playback is active;

computer program code for outputting a ringtone if a voice call is incoming and the media playback is not active;

computer program code for outputting the ringtone mixed with media output if a voice call is incoming and the media playback is active;

computer program code for receiving a second voice command;

computer program code for determining whether the second voice command corresponds to a request to answer the call;

computer program code for, in response to a determination that the second voice command corresponds to a request to answer the call, answering the call; and

computer program code for pausing or stopping the media playback if media playback is still active when the call is answered.

36. The non-transitory computer readable medium of claim 35, further comprising:

computer program code for determining whether the call has ended; and

computer program code for resuming or restarting the media playback after the call has ended.