Handling of loss of pairing between networked devices

• US 10,509,626 B2
• Filed: 04/18/2016
• Issued: 12/17/2019
• Est. Priority Date: 02/22/2016
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Plagge, Mark, Jarvis, Simon, Butts, Christopher
• Primary Examiner(s): Saint Cyr, Leonard
• Application Number:
  US15/131,254
• Publication Number:
  US 20170243587A1
• Time in Patent Office: 1,338 Days
• Field of Search: 704270-271
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/40052 High-speed IEEE 1394 serial bus bus transfer protocol on a daisy chain bus using an embedded synchronisation G06F13/426
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04L 41/0668 by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata

Abstract

Systems and methods disclosed herein include (i) receiving a voice command via a networked microphone device configured to receive voice commands for a media playback system, wherein the media playback system comprises a primary media playback device configured to perform a function and/or provide a first feedback in response to voice commands received via the networked microphone device, (ii) determining that the primary media playback device is not available to perform a function and/or provide the first feedback in response to the voice command, and (iii) in response to determining that the primary media playback device is not available to perform a function and/or provide the first feedback in response to the voice command, instructing a fallback device to perform a function and/or provide a second feedback in response to the voice command.

Claims

1. Tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by one or more processors, cause a networked microphone device to perform a method comprising:

receiving a voice command via the networked microphone device, wherein the networked microphone device is configured to receive voice commands for a media playback system, wherein the media playback system comprises a primary media playback device configured to provide a first feedback in response to voice commands received via the networked microphone device;

determining that the primary media playback device is not available to provide the first feedback in response to the voice command;

in response to determining that the primary media playback device is not available to provide the first feedback in response to the voice command, (i) selecting a fallback device from one or more media playback devices configured to play back media content in synchrony with the primary media playback device, and (ii) causing the fallback device to provide a second feedback in response to the voice command;

determining that the fallback device is no longer configured to play back media content in synchrony with the primary media playback device; and

selecting a secondary fallback device from the one or more media playback devices configured to play back media content in synchrony with the primary media playback device.

2. The tangible, non-transitory computer-readable media of claim 1, wherein determining that the primary media playback device is not available to provide the first feedback in response to the voice command comprises determining that the primary media playback device is one of (i) muted, (ii) in a do not interrupt state, (iii) in a power save mode, or (iv) unreachable via a network configured to support communications between the media playback system and the networked microphone device.

3. The tangible, non-transitory computer-readable media of claim 1, wherein determining that the primary media playback device is not available to provide the first feedback in response to the voice command comprises receiving a message from the media playback system indicating that the primary media playback device is not available.

4. The tangible, non-transitory computer-readable media of claim 1, wherein the method further comprises:

selecting the fallback device from a set of one or more fallback devices.

5. The tangible, non-transitory computer-readable media of claim 1, wherein selecting the fallback device from one or more media playback devices configured to play back media content in synchrony with the primary media playback device comprises (i) selecting the fallback device according to a pre-defined hierarchy of fallback devices or (ii) selecting a secondary media playback device as the fallback device, wherein the primary media playback device is configured to play back a first channel of media content and wherein the secondary media playback device is configured to play back a second channel of the media content.

6. The tangible, non-transitory computer-readable media of claim 1, wherein the fallback device is one of (i) a computing device configured to control the media playback system or (ii) the networked microphone device.

7. The tangible, non-transitory computer-readable media of claim 1, wherein the first feedback is one or more of (i) an audio feedback, (ii) a visual feedback, and (iii) a haptic feedback.

8. The tangible, non-transitory computer-readable media of claim 1, wherein the second feedback is one or more of (i) an audio feedback, (ii) a visual feedback, and (iii) a haptic feedback.

9. The tangible, non-transitory computer-readable media of claim 1, wherein the first feedback is the same as the second feedback.

10. The tangible, non-transitory computer-readable media of claim 1, wherein the method further comprises:

in response to determining that the primary media playback device is not available to provide the first feedback in response to the voice command, additionally causing the fallback device to indicate that the primary media playback device is unavailable, wherein indicating that the primary media playback device is unavailable comprises one or more of (i) an audio indication, (ii) a visual indication, and (iii) a haptic indication.

37. The tangible, non-transitory computer-readable media of claim 1, wherein the voice command comprises a command to play back media content, and in response to determining that the primary media playback device is not available to provide the first feedback in response to the voice command, further causing the fallback device to play back the media content.

11. A networked microphone device comprising:

one or more processors; and

tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by the one or more processors, cause the networked microphone device to perform a method comprising;

receiving a voice command via the networked microphone device, wherein the networked microphone device is configured to receive voice commands for a media playback system, wherein the media playback system comprises a primary media playback device configured to provide a first feedback in response to voice commands received via the networked microphone device;

determining that the primary media playback device is not available to provide the first feedback in response to the voice command;

in response to determining that the primary media playback device is not available to provide the first feedback in response to the voice command, (i) selecting a fallback device from one or more media playback devices configured to play back media content in synchrony with the primary media playback device, and (ii) causing the fallback device to provide a second feedback in response to the voice command;

determining that the fallback device is no longer configured to play back media content in synchrony with the primary media playback device; and

selecting a secondary fallback device from the one or more media playback devices configured to play back media content in synchrony with the primary media playback device.

12. The networked microphone device of claim 11, wherein determining that the primary media playback device is not available to provide the first feedback in response to the voice command comprises determining that the primary media playback device is one of (i) muted, (ii) in a do not interrupt state, (iii) in a power save mode, or (iv) unreachable via a network configured to support communications between the media playback system and the networked microphone device.

13. The networked microphone device of claim 11, wherein determining that the primary media playback device is not available to provide the first feedback in response to the voice command comprises receiving a message from the media playback system indicating that the primary media playback device is not available.

14. The networked microphone device of claim 11, wherein the method further comprises:

selecting the fallback device from a set of one or more fallback devices.

15. The networked microphone device of claim 11, wherein selecting the fallback device from one or more media playback devices configured to play back media content in synchrony with the primary media playback device comprises (i) selecting the fallback device according to a pre-defined hierarchy of fallback devices, or (ii) selecting a secondary media playback device as the fallback device, wherein the primary media playback device is configured to play back a first channel of media content and wherein the secondary media playback device is configured to play back a second channel of the media content.

16. The networked microphone device of claim 11, wherein the fallback device is one of (i) a computing device configured to control the media playback system or (ii) the networked microphone device.

17. The networked microphone device of claim 11, wherein the first feedback is one or more of (i) an audio feedback, (ii) a visual feedback, and (iii) a haptic feedback.

18. The networked microphone device of claim 11, wherein the second feedback is one or more of (i) an audio feedback, (ii) a visual feedback, and (iii) a haptic feedback.

19. The networked microphone device of claim 11, wherein the first feedback is the same as the second feedback.

20. The networked microphone device of claim 11, wherein the method further comprises:

in response to determining that the primary media playback device is not available to provide the first feedback in response to the voice command, additionally causing the fallback device to indicate that the primary media playback device is unavailable, wherein indicating that the primary media playback device is unavailable comprises one or more of (i) an audio indication, (ii) a visual indication, and (iii) a haptic indication.

21. Tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by one or more processors, cause a computing device to perform a method comprising:

determining that a primary networked microphone device of a networked microphone system is online but not available to receive voice commands for a media playback system, wherein the media playback system comprises one or more media playback devices configured to play back media content in synchrony;

in response to determining that the primary networked microphone device is online but not available to receive voice commands, (i) designating a fallback microphone to receive voice commands for the media playback system, wherein the fallback microphone comprises a first microphone on a first media playback device of the one or more media playback devices in the media playback system, and (ii) causing one or more media playback devices of the media playback system to indicate that the primary networked microphone device is unavailable, wherein indicating that the primary networked microphone device is unavailable comprises a visual indication;

determining that the first media playback device is no longer configured to play back media content in synchrony with the one or more media playback devices; and

designating a secondary fallback microphone to receive voice commands for the media playback system.

22. The tangible, non-transitory computer-readable media of claim 21, wherein determining that the primary networked microphone device of the networked microphone system is online but not available to receive voice commands for the media playback system comprises receiving a message indicating that the primary networked microphone device is not available to receive voice commands.

23. The tangible, non-transitory computer-readable media of claim 21, wherein the method further comprises:

in response to determining that the primary networked microphone device is online but not available to receive voice commands, additionally causing a computing device configured to control the media playback system to indicate that the primary networked microphone device is unavailable, wherein indicating that the primary networked microphone device is unavailable comprises one or more of (i) an audio indication, (ii) a second visual indication, and (iii) a haptic indication.

24. The tangible, non-transitory computer-readable media of claim 21, wherein indicating that the primary networked microphone device is unavailable further comprises a haptic indication.

25. The tangible, non-transitory computer-readable media of claim 21, wherein the secondary fallback microphone comprises a second microphone on a second media playback device of the one or more media playback devices in the media playback system.

26. The tangible, non-transitory computer-readable media of claim 21, wherein the fallback microphone comprises a second microphone on a computing device configured to control the media playback system.

27. The tangible, non-transitory computer-readable media of claim 21, wherein the fallback microphone comprises a second microphone on a secondary networked microphone device.

28. The tangible, non-transitory computer-readable media of claim 21, wherein the computing device is one of (i) a networked microphone device, (ii) a media playback device, (iii) a computing device configured to control the media playback system, (iv) a server system configured to communicate with the media playback system, or (iv) a server system configured to communicate with the networked microphone system.

29. A computing device comprising:

one or more processors; and

tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by the one or more processors, cause the computing device to perform a method comprising;

determining that a primary networked microphone device of a networked microphone system is online but not available to receive voice commands for a media playback system, wherein the media playback system comprises one or more media playback devices configured to play back media content in synchrony;

in response to determining that the primary networked microphone device is online but not available to receive voice commands, (i) designating a fallback microphone to receive voice commands for the media playback system, wherein the fallback microphone comprises a first microphone on a first media playback device of the one or more media playback devices in the media playback system, and (ii) causing one or more media playback devices of the media playback system to indicate that the primary networked microphone device is unavailable, wherein indicating that the primary networked microphone device is unavailable comprises a visual indication;

determining that the first media playback device is no longer configured to play back media content in synchrony with the one or more media playback devices; and

designating a secondary fallback microphone to receive voice commands for the media playback system.

30. The computing device of claim 29, wherein determining that the primary networked microphone device of the networked microphone system is online but not available to receive voice commands for the media playback system comprises receiving a message indicating that the primary networked microphone device is not available to receive voice commands.

31. The computing device of claim 29, wherein the method further comprises:

in response to determining that the primary networked microphone device is online but not available to receive voice commands, additionally causing a computing device configured to control the media playback system to indicate that the primary networked microphone device is unavailable, wherein indicating that the primary networked microphone device is unavailable comprises one or more of (i) an audio indication, (ii) a second visual indication, and (iii) a haptic indication.

32. The computing device of claim 29, wherein indicating that the primary networked microphone device is unavailable further comprises a haptic indication.

33. The computing device of claim 29, wherein the fallback microphone comprises a second microphone on a second media playback device of the one or more media playback devices in the media playback system.

34. The computing device of claim 29, wherein the fallback microphone comprises a second microphone on a computing device configured to control the media playback system.

35. The computing device of claim 29, wherein the fallback microphone comprises a second microphone on a secondary networked microphone device.

36. The computing device of claim 29, wherein the computing device is one of (i) a networked microphone device, (ii) a media playback device, (iii) a computing device configured to control the media playback system, (iv) a server system configured to communicate with the media playback system, or (iv) a server system configured to communicate with the networked microphone system.