Sound output system or internet appliance that supports voice activated commands, and that plays audio data received from a service over a network

• US 10,140,072 B2
• Filed: 04/21/2017
• Issued: 11/27/2018
• Est. Priority Date: 11/01/2000
• Status: Expired due to Fees

• Current Assignee: Flexiworld Technologies, Inc.
• Original Assignee: Flexiworld Technologies, Inc.
• Inventors: Chang, William Ho, Liu, Christina Ying
• Primary Examiner(s): Riley, Marcus T
• Application Number:
  US15/494,297
• Publication Number:
  US 20170228202A1
• Time in Patent Office: 585 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/1203 Improving or facilitating administration, e.g. print management
• CPC Class Codes: G06F 3/1205 resulting in increased flexibility in print job configuration, e.g. job settings, print requirements, job tickets
• CPC Class Codes: G06F 3/1208 resulting in improved quality of the output result, e.g. print layout, colours, workflows, print preview
• CPC Class Codes: G06F 3/122 with regard to computing resources, e.g. memory, CPU
• CPC Class Codes: G06F 3/1226 Discovery of devices having required properties
• CPC Class Codes: G06F 3/1228 Printing driverless or using generic drivers
• CPC Class Codes: G06F 3/1229 Printer resources management or printer maintenance, e.g. device status, power levels
• CPC Class Codes: G06F 3/1236 Connection management
• CPC Class Codes: G06F 3/1238 Secure printing, e.g. user identification, user rights for device usage, unallowed content, blanking portions or fields of a page, releasing held jobs
• CPC Class Codes: G06F 3/1245 by conversion to intermediate or common format
• CPC Class Codes: G06F 3/1247 by conversion to printer ready format
• CPC Class Codes: G06F 3/1253 Configuration of print job parameters, e.g. using UI at the client
• CPC Class Codes: G06F 3/1258 by updating job settings at the printer
• CPC Class Codes: G06F 3/128 Direct printing, e.g. sending document file, using memory stick, printing from a camera
• CPC Class Codes: G06F 3/1284 Local printer device
• CPC Class Codes: G06F 3/1285 Remote printer device, e.g. being remote from client or server
• CPC Class Codes: G06F 3/1286 via local network
• CPC Class Codes: G06F 3/1288 : in client-server-printer device configuration
• CPC Class Codes: G06F 3/1292 : Mobile client, e.g. wireless printing
• CPC Class Codes: G06F 3/14 : Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/162 : Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G06F 3/167 : Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06K 15/02 : using printers
• CPC Class Codes: G06K 15/181 : Receiving print data characterized by its formatting, e.g. particular page description languages
• CPC Class Codes: G06K 15/1836 : Rasterization
• CPC Class Codes: G06Q 20/10 : specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G10L 15/22 : Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 : Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 : Execution procedure of a spoken command
• CPC Class Codes: H04L 67/303 : Terminal profiles
• CPC Class Codes: H04L 67/51 : Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04N 1/00244 : with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00283 : with a television apparatus
• CPC Class Codes: H04N 1/00307 : with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00403 : Voice input means, e.g. voice commands
• CPC Class Codes: H04N 1/00411 : the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/00488 : providing an audible output to the user
• CPC Class Codes: H04N 1/00854 : Recognising an unauthorised user or user-associated action
• CPC Class Codes: H04N 1/00938 : Software related arrangements, e.g. loading applications program loading in general G06F9/445
• CPC Class Codes: H04N 1/32534 : details of interfacing
• CPC Class Codes: H04N 1/32582 : Output interface
• CPC Class Codes: H04N 1/4413 : involving the use of passwords, ID codes or the like, e.g. PIN
• CPC Class Codes: H04N 1/442 : using a biometric data reading device
• CPC Class Codes: H04N 2201/0039 : Connection via a network
• CPC Class Codes: H04N 2201/0041 : Point to point H04N2201/0039 takes precedence
• CPC Class Codes: H04N 2201/0053 : Optical, e.g. using an infrared link
• CPC Class Codes: H04N 2201/0055 : By radio
• CPC Class Codes: H04N 2201/0082 : Image hardcopy reproducer H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/0094 : Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception
• CPC Class Codes: H04N 7/16 : Analogue secrecy systems; Analogue subscription systems
• CPC Class Codes: H04W 12/06 : Authentication
• CPC Class Codes: H04W 12/068 : using credential vaults, e.g. password manager applications or one time password [OTP] applications
• CPC Class Codes: H04W 12/08 : Access security
• CPC Class Codes: H04W 4/80 : Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 76/10 : Connection setup
• CPC Class Codes: H04W 76/14 : Direct-mode setup
• CPC Class Codes: H04W 8/005 : Discovery of network devices, e.g. terminals
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]
• CPC Class Codes: Y02D 10/00 : Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

An output system, such as a wireless speaker or an Internet appliance, that supports voice activated commands is herein disclosed and enabled. The output system is wirelessly connectable to a service operated over a network (e.g., Internet) for receiving output data (e.g., music) from the service for outputting at the output system. The setup of the output system includes: (1) wirelessly discovering the output system using a smart phone, (2) establishing a wireless communication link between the smart phone and the output system (e.g., via Bluetooth or IEEE 802.11), and (3) providing information, such as security and/or authentication information, from the smart phone to the output system over the wireless communication link. Thereafter, the output system accesses the service operated over the network, and the outpt system is operabke to receive voice activated commands from a user while the output system is connected to the service.

Claims

1. A sound output system that is wirelessly connectable to one or more servers over a network for receiving audio output data from the one or more servers for outputting or playing the received audio output data at the sound output system, the sound output system includes:

a voice activated command interface for interacting with a user,

memory storing software or firmware,

one or more processors,

at least one sound output device or speaker,

a microphone, and

wireless communication circuitry for wireless communication;

wherein, when the one or more processors execute at least part of the software or firmware at the sound output system, the sound output system;

(1) wirelessly receives, using the wireless communication circuitry of the sound output system, data from a portable wireless device via a short range wireless communication link, the portable wireless device being a distinct device from the sound output system;

(2) processes an authentication procedure, at the sound output system, by detecting identification information or other information provided by the portable wireless device via the short range wireless communication link, and wherein, subsequent to processing the authentication procedure, the sound output system further;

(3) establishes, using the wireless communication circuitry at the sound output system, a wireless connection to the one or more servers over the network, the network includes a wireless local area network;

(4) receives, using the microphone and using the voice activated command interface, a voice activated command from the user;

(5) sends, using the wireless communication circuitry, a digital content object from the sound output system to the one or more servers over the network for processing at least part of audio digital content included in the digital content object, the sending of the digital content object is based on having received the voice activated command from the user;

(6) receives, using the wireless communication circuitry, audio output data from the one or more servers over the network, the audio output data includes audio data or sound data for output or playing at the sound output system, and the audio output data having a relationship, at least in part, to the audio digital content included in the digital content object sent from the sound output system to the one or more servers; and

(7) outputs or plays, using the at least one sound output device or speaker of the sound output system, at least part of the audio output data received from the one or more servers.

2. The sound output system according to claim 1, wherein the portable wireless device is at least one of a smart phone or an Internet pad with a touch sensitive screen interface.

3. The sound output system according to claim 2, wherein the sound output system further includes an interface with one or more of a button, a display, or other interfaces;

wherein, when the one or more processors execute at least part of the software or firmware at the sound output system, the sound output system further;

(a) provides, via the interface of the sound output system, at least an indication related to the sound output system; and

(b) subsequent to having provided the indication in (a), facilitates, using the wireless communication circuitry, a wireless discovery operation, the wireless discovery operation is for the portable wireless device to wirelessly discover the sound output system.

4. The sound output system according to claim 3, wherein, when the one or more processors execute at least part of the software or firmware at the sound output system, the sound output system further:

(c) transmits, using the wireless communication circuitry, at least one of attribute information or identification information related to the sound output system to the portable wireless device that has wirelessly discovered the sound output system in (b); and

(d) subsequent to having transmitted the at least one of attribute information or identification information in (c), establishes, using the wireless communication circuitry, a wireless communication link between the sound output system and the portable wireless device; and

wherein the receiving of the data from the portable wireless device in (1) is received via the wireless communication link established in (d), and wherein the wireless communication circuitry further supports at least a protocol within IEEE 802.11 standards or Bluetooth specifications for establishing the wireless communication link between the sound output system and the portable wireless device in (d).

5. The sound output system according to claim 2, wherein the wireless communication circuitry includes at least one wireless communication unit, the least one wireless communication unit includes one or more chips or chipsets for wireless communication, the one or more chips or chipsets support at least a protocol within IEEE 802.11 standards for establishing a wireless local area network connection that includes the wireless local area network in (3).

6. The sound output system according to claim 5, wherein the one or more servers over the network are operated, at least partly, by a digital content service, the digital content service is for providing digital content to users who have signed up or have subscribed to the digital content service, and wherein the audio output data for outputting or playing at the sound output system includes audio digital content received from the digital content service, and the digital content service is operated, at least partly, over the Internet;

and

wherein, the sound output system further establishes, using the wireless communication circuitry of the sound output system, a connection to the digital content service, and wherein the receiving of the audio output data is based, at least in part, on having authentication information for accessing the digital content service.

7. The sound output system according to claim 5, wherein, when the one or more processors execute at least part of the software or firmware at the sound output system and subsequent to establishing the wireless connection in (3), the sound output system:

(i) downloads, using the wireless communication circuitry and via the wireless connection established in (3), application software or software components or data from the one or more servers over the network, the application software or software components or data is for upgrading, updating, or modifying features and capabilities of the sound output system; and

(ii) installs, using the one or more processors at the sound output system, the application software or software components or data downloaded in (i), and

wherein the sending of the digital content object to the one or more servers and the receiving of the audio output data from the one or more servers are both facilitated, at least in part, using the application software or software components or data downloaded in (i) and installed in (ii).

8. A method for setting up an output system to receive voice activated commands from a user, the output system includes:

one or more sound output devices for outputting sound,

a microphone,

a voice activated command interface for interacting with the user, and

wireless communication circuitry, the method, comprising;

(1) establishing, using the wireless communication circuitry at the output system, a short range wireless communication link between the output system and a portable wireless device, the portable wireless device is a distinct device from the output system, and the portable wireless device is at least one of a smart phone or an information pad;

(2) receiving, using the wireless communication circuitry at the output system and via the established short range wireless communication link, information from the portable wireless device, and, subsequent to having received the information from the portable wireless device, the method further comprises;

(3) coupling the output system to a network using the wireless communication circuitry at the output system, the network includes a wireless local area network;

(4) accessing, using the wireless communication circuitry of the output system, one or more servers over the network, the one or more servers providing, at least in part, a service that is accessible, at least partly, over the Internet;

(5) receiving, via the microphone, a voice activated command from the user, the receiving of the voice activated command is related to outputting or playing digital content;

(6) receiving, via the wireless communication circuitry at the output system, audio output data from the one or more servers, the receiving of the audio output data from the one or more servers is subsequent to the output system having received the voice activated command from the user, via the voice activated command interface; and

(7) outputting or playing, using the one or more sound output devices included in the output system, at least part of the audio output data received from the one or more servers, wherein the audio output data is related to the digital content that includes audio data or voice data, individually or in any combination.

9. The method according to claim 8, wherein the output system is embodied, at least in part, as a speaker or an Internet appliance, individually or in any combination, and

wherein the output system does not include a conventional personal computer, a desktop personal computer, or a laptop computer.

10. The method according to claim 8, wherein the wireless communication circuitry includes one or more chips or chipsets for wireless communication;

at least one chip or chipset of the one or more chips or chipsets supporting at least a protocol within IEEE 802.11 standards for establishing a wireless local area network connection, and wherein the coupling of the output system to the network includes the output system coupling, using the one or more chips or chipsets, to the wireless local area network, and at least one chip or chipset of the one or more chips or chipsets supporting at least a protocol within IEEE 802.11 standards or within Bluetooth specifications for establishing the short range wireless communication link in.

11. The method according to claim 10, wherein the one or more servers are operated, at least partly, by a digital content service, the digital content service is for providing digital content to users who have signed up or subscribed to the service, and the method further comprises:

obtaining, at the output system, authentication information for accessing the digital content service; and

wherein the accessing of the one or more servers in (4), by the output system, includes the output system using, at least in part, the authentication information obtained at the output system, and wherein the authentication information includes one or more of a user name, a password, an ID number, a security key, or biometric information, individually or in any combination.

12. The method of claim 10, wherein subsequent to accessing the one or more servers, the method further comprises:

(i) receiving, via the microphone of the output system, voice activated commands from the user;

(ii) sending, from the output system and using the wireless communication circuitry, a digital content object to the one or more servers over the network in response to the voice activated commands received in (i);

(iii) receiving, by the output system and using the wireless communication circuitry, output data from the one or more servers over the network for outputting at the output system, the receiving of the output data being in response to having sent the digital content object to the one or more servers in (ii); and

(iv) outputting or playing, at the output system and using the one or more sound output devices, at least part of the output data received in (iii), the at least part of the output data includes audio digital content or voice digital content.

13. The method according to claim 10, wherein the output system further includes an interface;

and wherein, prior to establishing the short range wireless communication link with the portable wireless device in (1), the method further comprises;

(a) receiving, by the output system and via the interface of the output system, an indication from the user for operating the output system;

(b) facilitating, using the wireless communication circuitry of the output system, a wireless discovery operation, the wireless discovery operation is for the portable wireless device to wirelessly discover the output system, the wireless discovery operation being subsequent to having received the indication from the user in (a);

(c) transmitting, from the output system and using the wireless communication circuitry, at least one of attribute information or identification information related to the output system, to the portable wireless device for the user of the portable wireless device to identify or to select the output system for service; and

(d) receiving, by the output system and using the wireless communication circuitry, a service request from the portable wireless device based, at least in part, on having transmitted the at least one of attribute information or identification information.

14. The method according to claim 8, wherein the wireless communication circuitry includes one or more chips or chipsets for wireless communication that support at least a protocol within IEEE 802.11 standards or Bluetooth specifications for establishing the short range wireless communication link in (1), and wherein the short range wireless communication link established in (1) is one of a direct short range wireless communication link between the output system and the portable wireless device or wireless local area network communication between the output system and the portable wireless device.

15. An output system for receiving voice activated commands from a user and for outputting sound, the output system includes

at least one sound output device,

a microphone,

an interface, and

wireless communication circuitry, wherein the output system is configured to:

(1) provide, via the interface of the output system, at least an indication related to the output system;

(2) facilitate, using the wireless communication circuitry of the output system, a wireless discovery process, the wireless discovery process is for a portable wireless device to wirelessly discover the output system, the portable wireless device is a distinct device from the output system, and the wireless discovery process is based, at least in part, on short range wireless communication or local area wireless communication between the portable wireless device and the output system;

(3) establish, via the wireless communication circuitry of the output system, a wireless communication link between the output system and the portable wireless device that has wirelessly discovered the output system, and the portable wireless device is at least one of a smart phone or an information pad having a touch sensitive screen interface;

(4) wirelessly receive, by the wireless communication circuitry of the output system and over the established wireless communication link, information from the portable wireless device;

(5) connect the output system, via the wireless communication circuitry of the output system, to one or more servers over a network that includes a wireless local area network, the connecting to the one or more servers over the network being subsequent to the output system having established the wireless communication link with the portable wireless device;

(6) receive, via a voice activated command interface of the output system, a voice activated command from the user;

(7) receive, by the output system and via the wireless communication circuitry, audio output data from the one or more servers over the network subsequent to having received the voice activated command, the audio output data includes at least one of sound, voice, or music, individually or in any combination; and

(8) output or play, using the at least one sound output device of the output system, at least part of the audio output data received from the one or more servers.

16. The output system according to claim 15, wherein the wireless communication circuitry of the output system is further configured to:

(a) receive, by the wireless communication circuitry of the output system and via the established wireless communication link in (3), information from the portable wireless device, the information is related, at least in part, to an authentication procedure processed by the output system, the authentication procedure includes detecting by the output system one or more of a name, a password, an ID number, a PIN, biometric information, identification information, or a security key, individually or in any combination; and

(b) establish, via the wireless communication circuitry, a wireless local area network connection.

17. The output system according to claim 16, wherein the one or more servers provide a service, at least partly, over the network that includes the Internet, and wherein the connecting to the one or more servers in (5) includes the output system providing to the one or more servers one or more of subscription information, identification information, security information, or authentication information, individually or in any combination, related to the user;

and

wherein the wireless discovery process, using the wireless communication circuitry, is based, at least in part, on physical proximity between the portable wireless device and the output system.

18. The output system according to claim 15, wherein the wireless communication circuitry includes one or more chips or chipsets for wireless communication that support at least a protocol within IEEE 802.11 standards for establishing the wireless local area network connection in (b), and at least one chip or chipset of the one or more chips or chipsets supports at least a protocol within Bluetooth specifications or within IEEE 802.11 standards for establishing the wireless communication link in (3).

19. The output system according to claim 18, wherein the wireless communication circuitry of the output system is further configured to:

(i) wirelessly send, via the wireless communication circuitry, a digital content object from the output system to the one or more servers over the network, the digital content object including sound data or voice data, and the sending of the digital content object is in response to having received one or more voice activated commands from the user;

(ii) wirelessly receive, via the wireless communication circuitry and from the one or more servers over the network, audio output data, the audio output data includes audio data or sound data for outputting at the output system, and the receiving of the audio output data is in response to having wirelessly sent the digital content object to the one or more servers over the network in (i), and

(iii) output or play, using the at least one sound output device of the output system, at least part of the audio output data received in (ii).

20. The output system according to claim 18, wherein the output system is embodied as a speaker or an Internet appliance, individually or in any combination, and wherein the output system does not include a conventional personal computer, a desktop personal computer, or a laptop computer;

and wherein the wireless communication circuitry of the output system is further configured to;

(i) transmit, using the wireless communication circuitry, information related to the output system to the portable wireless device for the user of the portable wireless device to identify or to select the output system for a service; and

(ii) receive, using the wireless communication circuitry at the output system, a service request from the portable wireless device based on having transmitted the information to the portable wireless device, and

wherein the establishing of the wireless communication link between the output system and the portable wireless device is subsequent to having received the service request.