Method of and apparatus for configuring and controlling home entertainment systems through natural language and spoken commands using a natural language server

• US 6,895,379 B2
• Filed: 03/27/2002
• Issued: 05/17/2005
• Est. Priority Date: 03/27/2002
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Stone, Glen David, Smyers, Scott David, Fairman, Bruce Alan
• Primary Examiner(s): Knepper, David D.
• Application Number:
  US10/112,244
• Publication Number:
  US 20030187646A1
• Time in Patent Office: 1,147 Days
• Field of Search: 704/270, 704/270.1, 704/275, 707/5, 379/88.01
• US Class Current: 704/270.1
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

When a user'"'"'s request is entered it is then transmitted to a network interface unit which digitizes and stores the request. The digitized request and information about the user'"'"'s network of devices is then transmitted from the network interface unit to a natural language server, preferably over the internet. The natural language server then processes the request and generates commands necessary to complete the request within the user'"'"'s network of devices. These commands are then transmitted from the natural language server to the network interface unit. The network interface unit then transmits the commands to the appropriate devices within the network of devices. The devices within the network of devices then execute the received commands to complete the user'"'"'s request.

Claims

1. A method of configuring and controlling a network of devices through a natural language request comprising:

a. receiving a natural language request from a user;

b. storing the natural language request;

c. transmitting the natural language request to a natural language server;

d. generating commands to complete the natural language request using the network of devices; and

e. transmitting the commands to appropriate devices within the network of devices to complete the natural language request.

2. The method as claimed in claim 1 further comprising determining intention of the natural language request at the natural language server.

3. The method as claimed in claim 1 wherein transmitting the natural language request to a natural language server includes transmitting information about configuration of the network of devices.

4. The method as claimed in claim 1 wherein transmitting the natural language request to a natural language server is completed by a network interface unit within the network of devices and transmitting the commands to appropriate devices within the network of devices includes transmitting the commands to the network interface unit and then transmitting the commands from the network interface unit to the appropriate devices within the network of devices.

5. The method as claimed in claim 1 wherein the natural language request is a selective one of a spoken request and a request entered using an input device.

6. The method as claimed in claim 1 wherein the natural language request is requesting a selective one of information and a control action to be performed within the network of devices.

7. The method as claimed in claim 1 wherein the natural language server is remote from the network of devices.

8. The method as claimed in claim 7 wherein the natural language server is accessed over an internet connection.

9. The method as claimed in claim 1 wherein the natural language server is included within the network of devices.

10. The method as claimed in claim 1 wherein the network of devices substantially complies with a version of the IEEE 1394 standard.

11. A network interface unit for receiving a natural language request from a user, the network interface unit comprising:

a. a first interface configured to communicate with one or more devices within a network of devices to receive the natural language request from the user;

b. a second interface configured to communicate with a natural language server to transmit the natural language request to the natural language server and to receive commands back from the natural language server to execute the natural language request within the network of devices; and

c. a control circuit coupled to the first interface to control the communication with the one or more devices and to the second interface to control the communication with the natural language server, wherein when the natural language request is received by the first interface, the natural language request is transmitted to the natural language server and further wherein when the commands are received back from the natural language server, the commands are transmitted from the first interface to the network of devices to execute the natural language request.

12. The network interface unit as claimed in claim 11 wherein information about configuration of the network of devices is also transmitted to the natural language server.

13. The network interface unit as claimed in claim 11 wherein the natural language request is a selective one of a spoken request and a request entered using an input device.

14. The network interface unit as claimed in claim 11 wherein the natural language request is requesting a selective one of information and a control action to be performed within the network of devices.

15. The network interface unit as claimed in claim 11 wherein the natural language server is remote from the network of devices.

16. The network interface unit as claimed in claim 15 wherein the second interface provides an internet connection through which the natural language server is accessed.

17. The network interface unit as claimed in claim 11 wherein the natural language server is included within the network of devices.

18. The network interface unit as claimed in claim 17 wherein the first and second interfaces are integrated into a single interface circuit.

19. The network interface unit as claimed in claim 11 wherein the network of devices substantially complies with a version of the IEEE 1394 standard.

20. A natural language server for receiving a natural language request and generating commands to complete the natural language request within a network of devices, the natural language server comprising:

a. an interface circuit configured to receive the natural language request from a network interface unit; and

b. a control circuit coupled to the interface circuit and configured to process the natural language request and generate commands necessary to execute the natural language request within the network of devices, wherein the commands are transmitted to the network interface unit through the interface circuit.

21. The natural language server as claimed in claim 20 wherein information about configuration of the network of devices is also received by the interface circuit from the network interface unit.

22. The natural language server as claimed in claim 20 wherein the natural language request is a selective one of a spoken request and a request entered using an input device.

23. The natural language server as claimed in claim 20 wherein the natural language request is requesting a selective one of information and a control action to be performed within the network of devices.

24. The natural language server as claimed in claim 20 wherein the natural language server is remote from the network of devices.

25. The natural language server as claimed in claim 24 wherein the interface circuit provides an internet connection for communicating with the network interface unit.

26. The natural language server as claimed in claim 20 wherein the natural language server is included within the network of devices.

27. The natural language server as claimed in claim 20 wherein the network of devices substantially complies with a version of the IEEE 1394 standard.

28. A network of devices comprising:

a. one or more devices;

b. a natural language server comprising;

i. a first interface configured to receive a natural language request; and

ii. a first control circuit coupled to the first interface and configured to process the natural language request and generate commands necessary to execute the natural language request within the one or more devices; and

c. a network interface unit comprising;

i. a second interface configured to communicate with the one or more devices to receive the natural language request from a user;

ii. a third interface configured to communicate with the natural language server to transmit the natural language request to the natural language server and to receive the commands back from the natural language server to execute the natural language request within the one or more devices; and

iii. a control circuit coupled to the second interface to control the communication with the one or more devices and to the third interface to control the communication with the natural language server, wherein when the natural language request is received by the first interface, the natural language request is transmitted to the natural language server and further wherein when the commands are received back from the natural language server, the commands are transmitted from the second interface to the one or more devices to execute the natural language request.

29. The network of devices as claimed in claim 28 wherein information about configuration of the one or more devices is also transmitted from the network interface unit to the natural language server.

30. The network of devices as claimed in claim 28 wherein the natural language request is a selective one of a spoken request and a request entered using an input device.

31. The network of devices as claimed in claim 28 wherein the natural language request is requesting a selective one of information and a control action to be performed by the one or more devices.

32. The network of devices as claimed in claim 28 wherein the natural language server is remote from the one or more devices.

33. The network of devices as claimed in claim 32 wherein the first interface and the third interface communicate over an internet connection.

34. The network of devices as claimed in claim 28 wherein the natural language server is coupled locally with the one or more devices.

35. The network of devices as claimed in claim 34 wherein the second and third interfaces are integrated into a single interface circuit.

36. The network of devices as claimed in claim 28 wherein the one or more devices and the network interface circuit are coupled together within a network substantially complying with a version of the IEEE 1394 standard.

37. A method of configuring and controlling a network of devices through a natural language request comprising:

a. receiving a natural language request from a user;

b. storing the natural language request;

c. transmitting the natural language request to a natural language server;

d. determining an intention of the user from the natural language request;

e. generating commands to complete the intention using the network of devices; and

e. transmitting the commands to appropriate devices within the network of devices to complete the natural language request.

38. A method of configuring and controlling a network of devices through a natural language request comprising:

a. receiving a natural language request from a user;

b. storing the natural language request;

c. transmitting the natural language request to a natural language server;

d. determining if the natural language request is a spoken request or a request entered using an input device;

e. converting the natural language request from speech to data using speech recognition when the natural language request is a spoken request;

f. generating commands to complete the natural language request using the network of devices; and

g. transmitting the commands to appropriate devices within the network of devices to complete the natural language request.