Handling of loss of pairing between networked devices

• US 20170243587A1
• Filed: 04/18/2016
• Published: 08/24/2017
• Est. Priority Date: 02/22/2016
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Plagge, Mark, Jarvis, Simon, Butts, Christopher
• Granted Patent: US 10,509,626 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/40052 High-speed IEEE 1394 serial bus bus transfer protocol on a daisy chain bus using an embedded synchronisation G06F13/426
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04L 41/0668 by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata

Abstract

Systems and methods disclosed herein include (i) receiving a voice command via a networked microphone device configured to receive voice commands for a media playback system, wherein the media playback system comprises a primary media playback device configured to perform a function and/or provide a first feedback in response to voice commands received via the networked microphone device, (ii) determining that the primary media playback device is not available to perform a function and/or provide the first feedback in response to the voice command, and (iii) in response to determining that the primary media playback device is not available to perform a function and/or provide the first feedback in response to the voice command, instructing a fallback device to perform a function and/or provide a second feedback in response to the voice command.

Claims

1. Tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by one or more processors, cause a networked microphone device to perform a method comprising:

receiving a voice command via the networked microphone device, wherein the networked microphone device is configured to receive voice commands for a media playback system, wherein the media playback system comprises a primary media playback device configured to provide a first feedback in response to voice commands received via the networked microphone device;

determining that the primary media playback device is not available to provide the first feedback in response to the voice command; and

in response to determining that the primary media playback device is not available to provide the first feedback in response to the voice command, instructing a fallback device to provide a second feedback in response to the voice command.

2. The tangible, non-transitory computer-readable media of claim 1, wherein determining that the primary media playback device is not available to provide the first feedback in response to the voice command comprises determining that the primary media playback device is one of (i) muted, (ii) in a do not interrupt state, (iii) in a power save mode, or (iv) unreachable via a network configured to support communications between the media playback system and the networked microphone device.

3. The tangible, non-transitory computer-readable media of claim 1, wherein determining that the primary media playback device is not available to provide the first feedback in response to the voice command comprises receiving a message from the media playback system indicating that the primary media playback device is not available.

4. The tangible, non-transitory computer-readable media of claim 1, wherein the method further comprises:

selecting a fallback device from a set of one or more fallback devices.

5. The tangible, non-transitory computer-readable media of claim 1, wherein the method further comprises:

selecting a fallback device from a set of one or more fallback devices, wherein selecting a fallback device from a set of one or more fallback devices comprises one of (i) selecting a fallback device according to a pre-defined hierarchy of fallback devices, (ii) selecting a fallback device from one or more media playback devices configured to playback media content in synchrony with the primary media playback device, (iii) selecting a fallback device from one or more media playback devices that were previously configured to playback media content in synchrony with the primary media playback device, or (iv) selecting a secondary media playback device as the fallback device, wherein the primary media playback device is configured to play back a first channel of media content and wherein the secondary media playback device is configured to play back a second channel of the media content.

6. The tangible, non-transitory computer-readable media of claim 1, wherein the fallback device is one of (i) a computing device configured to control the media playback system or (ii) the networked microphone device.

7. The tangible, non-transitory computer-readable media of claim 1, wherein the first feedback is one or more of (i) an audio feedback, (ii) a visual feedback, and (iii) a haptic feedback.

8. The tangible, non-transitory computer-readable media of claim 1, wherein the second feedback is one or more of (i) an audio feedback, (ii) a visual feedback, and (iii) a haptic feedback.

9. The tangible, non-transitory computer-readable media of claim 1, wherein the first feedback is the same as the second feedback.

10. The tangible, non-transitory computer-readable media of claim 1, wherein the method further comprises:

in response to determining that the primary media playback device is not available to provide the first feedback in response to the voice command, additionally instructing the fallback device to indicate that the primary media playback device is unavailable, wherein indicating that the primary media playback device is unavailable comprises one or more of (i) an audio indication, (ii) a visual indication, and (iii) a haptic indication.

11. A networked microphone device comprising:

one or more processors; and

tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by the one or more processors, cause the networked microphone device to perform a method comprising;

receiving a voice command via the networked microphone device, wherein the networked microphone device is configured to receive voice commands for a media playback system, wherein the media playback system comprises a primary media playback device configured to provide a first feedback in response to voice commands received via the networked microphone device;

determining that the primary media playback device is not available to provide the first feedback in response to the voice command; and

in response to determining that the primary media playback device is not available to provide the first feedback in response to the voice command, instructing a fallback device to provide a second feedback in response to the voice command.

12. The networked microphone device of claim 11, wherein determining that the primary media playback device is not available to provide the first feedback in response to the voice command comprises determining that the primary media playback device is one of (i) muted, (ii) in a do not interrupt state, (iii) in a power save mode, or (iv) unreachable via a network configured to support communications between the media playback system and the networked microphone device.

13. The networked microphone device of claim 11, wherein determining that the primary media playback device is not available to provide the first feedback in response to the voice command comprises receiving a message from the media playback system indicating that the primary media playback device is not available.

14. The networked microphone device of claim 11, wherein the method further comprises:

selecting a fallback device from a set of one or more fallback devices.

15. The networked microphone device of claim 11, wherein the method further comprises:

selecting a fallback device from a set of one or more fallback devices, wherein selecting a fallback device from a set of one or more fallback devices comprises one of (i) selecting a fallback device according to a pre-defined hierarchy of fallback devices, (ii) selecting a fallback device from one or more media playback devices configured to playback media content in synchrony with the primary media playback device, (iii) selecting a fallback device from one or more media playback devices that were previously configured to playback media content in synchrony with the primary media playback device, or (iv) selecting a secondary media playback device as the fallback device, wherein the primary media playback device is configured to play back a first channel of media content and wherein the secondary media playback device is configured to play back a second channel of the media content.

16. The networked microphone device of claim 11, wherein the fallback device is one of (i) a computing device configured to control the media playback system or (ii) the networked microphone device.

17. The networked microphone device of claim 11, wherein the first feedback is one or more of (i) an audio feedback, (ii) a visual feedback, and (iii) a haptic feedback.

18. The networked microphone device of claim 11, wherein the second feedback is one or more of (i) an audio feedback, (ii) a visual feedback, and (iii) a haptic feedback.

19. The networked microphone device of claim 11, wherein the first feedback is the same as the second feedback.

20. The networked microphone device of claim 11, wherein the method further comprises:

in response to determining that the primary media playback device is not available to provide the first feedback in response to the voice command, additionally instructing the fallback device to indicate that the primary media playback device is unavailable, wherein indicating that the primary media playback device is unavailable comprises one or more of (i) an audio indication, (ii) a visual indication, and (iii) a haptic indication.

21. Tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by one or more processors, cause a computing device device to perform a method comprising:

determining that a primary networked microphone device of a networked microphone system is not available to receive voice commands for a media playback system, wherein the media playback system comprises one or more media playback devices; and

in response to determining that the primary networked microphone device is not available to receive voice commands, designating a fallback microphone to receive voice commands for the media playback system.

22. The tangible, non-transitory computer-readable media of claim 21, wherein determining that a primary networked microphone device of a networked microphone system is not available to receive voice commands for a media playback system comprises receiving a message indicating that the primary microphone device is not available to receive voice commands.

23. The tangible, non-transitory computer-readable media of claim 21, wherein the method further comprises:

in response to determining that the primary networked microphone device is not available to receive voice commands, additionally instructing a computing device configured to control the media playback system to indicate that the primary networked microphone device is unavailable, wherein indicating that the primary networked microphone device is unavailable comprises one or more of (i) an audio indication, (ii) a visual indication, and (iii) a haptic indication.

24. The tangible, non-transitory computer-readable media of claim 21, wherein the method further comprises:

in response to determining that the primary networked microphone device is not available to receive voice commands, additionally instructing one or more media playback devices of the media playback system to indicate that the primary networked microphone device is unavailable, wherein indicating that the primary networked microphone device is unavailable comprises one or more of (i) an audio indication, (ii) a visual indication, and (iii) a haptic indication.

25. The tangible, non-transitory computer-readable media of claim 21, wherein the fallback microphone comprises a microphone on a media playback device in the media playback system.

26. The tangible, non-transitory computer-readable media of claim 21, wherein the fallback microphone comprises a microphone on a computing device configured to control the media playback system.

27. The tangible, non-transitory computer-readable media of claim 21, wherein the fallback microphone comprises a microphone on a secondary networked microphone device.

28. The tangible, non-transitory computer-readable media of claim 21, wherein the computing device is one of (i) a networked microphone device, (ii) a media playback device, (iii) a computing device configured to control the media playback system, (iv) a server system configured to communicate with the media playback system, or (iv) a server system configured to communicate with the networked microphone system.

30. The computing device of claim 21, wherein determining that a primary networked microphone device of a networked microphone system is not available to receive voice commands for a media playback system comprises receiving a message indicating that the primary microphone device is not available to receive voice commands.

31. The computing device of claim 21, wherein the method further comprises:

in response to determining that the primary networked microphone device is not available to receive voice commands, additionally instructing a computing device configured to control the media playback system to indicate that the primary networked microphone device is unavailable, wherein indicating that the primary networked microphone device is unavailable comprises one or more of (i) an audio indication, (ii) a visual indication, and (iii) a haptic indication.

32. The computing device of claim 21, wherein the method further comprises:

in response to determining that the primary networked microphone device is not available to receive voice commands, additionally instructing one or more media playback devices of the media playback system to indicate that the primary networked microphone device is unavailable, wherein indicating that the primary networked microphone device is unavailable comprises one or more of (i) an audio indication, (ii) a visual indication, and (iii) a haptic indication.

33. The computing device of claim 21, wherein the fallback microphone comprises a microphone on a media playback device in the media playback system.

34. The computing device of claim 21, wherein the fallback microphone comprises a microphone on a computing device configured to control the media playback system.

35. The computing device of claim 21, wherein the fallback microphone comprises a microphone on a secondary networked microphone device.

36. The computing device of claim 21, wherein the computing device is one of (i) a networked microphone device, (ii) a media playback device, (iii) a computing device configured to control the media playback system, (iv) a server system configured to communicate with the media playback system, or (iv) a server system configured to communicate with the networked microphone system.

29. A computing device comprising:

one or more processors; and

tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by the one or more processors, cause the computing device to perform a method comprising;

determining that a primary networked microphone device of a networked microphone system is not available to receive voice commands for a media playback system, wherein the media playback system comprises one or more media playback devices; and

in response to determining that the primary networked microphone device is not available to receive voice commands, designating a fallback microphone to receive voice commands for the media playback system.