INFORMATION PROVISION METHOD USING VOICE RECOGNITION FUNCTION AND CONTROL METHOD FOR DEVICE

• US 20150331665A1
• Filed: 05/01/2015
• Published: 11/19/2015
• Est. Priority Date: 05/13/2014
• Status: Abandoned Application

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: KOJIMA, YOSHIHIRO, ISHII, YASUNORI
• Application Number:
  US14/701,538
• Publication Number:
  US 20150331665A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/4826 using recommendation lists, e.g. of programs or channels sorted out according to their score

Abstract

According to one embodiment, there is provided an information provision method in an information provision system connected to a display device having a display and a voice input apparatus capable of inputting a user'"'"'s voice for providing information via the display device in response to the user'"'"'s voice. The method includes transmitting display screen information for displaying a display screen including a plurality of selectable items on the display to the display device, receiving item selection information indicating selection of one of the plurality of items on the display screen, recognizing instruction substance if a voice instruction including first voice information representing the instruction substance is received from the voice input apparatus when the one item is selected, judging whether the voice instruction includes second voice information indicating a demonstrative term, and executing the instruction substance for the one item if a positive judgment is made.

Claims

1. An information provision method in an information provision system connected to a display device having a display and a voice input apparatus capable of inputting a voice of a user for providing information via the display device in response to the voice of the user, comprising:

transmitting display screen information for displaying a display screen including a plurality of selectable items on the display of the display device to the display device;

receiving item selection information indicating that one item of the plurality of items is selected on the display screen of the display;

recognizing instruction substance from first voice information representing the instruction substance if a voice instruction including the first voice information is received from the voice input apparatus when the one item is selected;

judging whether the voice instruction includes second voice information indicating a demonstrative term; and

executing the instruction substance for the one item if the voice instruction is judged to include the second voice information.

2. The information provision method according to claim 1, wherein the instruction substance is an instruction to search for information related to the one item, and the information provision method further includes notifying the user of a result of a search based on the instruction substance.

3. The information provision method according to claim 2, further comprising:

transmitting search result information for displaying the result of the search on the display to the display device.

4. The information provision method according to claim 2, wherein the information provision system is further connected to a voice output apparatus capable of outputting a voice, and the information provision method further includes transmitting search result information for outputting the result of the search as a voice from the voice output apparatus to the voice output apparatus.

5. The information provision method according to claim 1, wherein the plurality of items are each an item which points to metadata related to a television program or content of a television program.

6. The information provision method according to claim 5, wherein the metadata indicates at least one of a television program title, a channel name, a summary of the television program, an attention degree of the television program, and a recommendation degree of the television program.

7. The information provision method according to claim 5, wherein the content of the television program includes information indicating at least one of a person, an animal, a car, a map, a character, and a numeral.

8. The information provision method according to claim 1, wherein the display screen represents a map in a specific region, and the plurality of items are each arbitrary coordinates on the map or an object on the map.

9. The information provision method according to claim 8, wherein the object indicates a building on the map.

10. The information provision method according to claim 8, wherein the object indicates a road on the map.

11. The information provision method according to claim 8, wherein the object indicates a place name on the map.

12. A control method for a display device connected to a voice input apparatus capable of inputting a voice of a user and having a display, the control method causing a computer of the display device to:

display a display screen including a plurality of selectable items on the display;

sense that one item of the plurality of items is selected on the display screen of the display;

recognize instruction substance from first voice information representing the instruction substance and execute the instruction substance if a voice instruction including the first voice information is received from the voice input apparatus when selection of the one item is sensed; and

transmit the voice instruction to a different computer if selection of the one item is not sensed or if the instruction substance is judged to be inexecutable.

13. The control method according to claim 12, the control method further causing the computer of the display device to:

judge whether the voice instruction includes second voice information indicating a demonstrative term;

execute the instruction substance if selection of the one item is sensed, the instruction substance is recognized from the first voice information, and the voice instruction is judged to include the second voice information; and

transmit the voice instruction to the different computer if selection of the one item is not sensed, if the instruction substance is not recognized from the first voice information, or if the voice instruction is not judged to include the second voice information.

14. The control method according to claim 12, wherein the instruction substance is an instruction to search for information related to the one item, and the control method further causes the computer of the display device to notify the user of a result of a search based on the instruction substance.

15. The control method according to claim 14, wherein the display device is connected to a server via a network, and the control method further causes the computer of the display device to refer to a database in the server and to search for information related to the one item in the database.

16. The control method according to claim 14, wherein the control method further causes the computer of the display device to display the result of the search on the display.

17. The control method according to claim 12, wherein the voice input apparatus is included in the display device.

18. The control method according to claim 14, wherein the display device is further connected to a voice output apparatus capable of outputting a voice, and the control method further causes the computer of the display device to transmit search result information for outputting the result of the search as a voice from the voice output apparatus to the voice output apparatus.

19. The control method according to claim 18, wherein the voice output apparatus is included in the display device.

20. The control method according to claim 12, wherein the plurality of items are each an item which points to metadata related to a television program or content of a television program.

21. The control method according to claim 20, wherein the metadata indicates at least one of a television program title, a channel name, a summary of the television program, an attention degree of the television program, and a recommendation degree of the television program.

22. The control method according to claim 20, wherein the content of the television program includes information indicating at least one of a person, an animal, a car, a map, a character, and a numeral.

23. The control method according to claim 12, wherein the display screen represents a map in a specific region, and the plurality of items are each arbitrary coordinates on the map or an object on the map.

24. The control method according to claim 23, wherein the object indicates a building on the map.

25. The control method according to claim 23, wherein the object indicates a road on the map.

26. The control method according to claim 23, wherein the object indicates a place name on the map.

27. A non-transitory recording medium storing a computer program to be executed by a display device connected to a voice input apparatus capable of inputting a voice of a user and having a display, the computer program causing a computer of the display device to:

display a display screen including a plurality of selectable items on the display;

sense that one item of the plurality of items is selected on the display screen of the display;

recognize instruction substance from first voice information representing the instruction substance and execute the instruction substance if a voice instruction including the first voice information is received from the voice input apparatus when selection of the one item is sensed; and

transmit the voice instruction to a different computer if selection of the one item is not sensed or if the instruction substance is judged to be inexecutable.

28. A display device connected to a voice input apparatus capable of inputting a voice of a user, comprising:

a display;

a controller; and

a communicator,

wherein the controller

displays a display screen including a plurality of selectable items on the display,

senses that one item of the plurality of items is selected on the display screen of the display,

recognizes instruction substance from first voice information representing the instruction substance and executes the instruction substance if a voice instruction including the first voice information is received from the voice input apparatus when selection of the one item is sensed, and

instructs the communicator to transmit the voice instruction to a different computer if selection of the one item is not sensed or if the instruction substance is judged to be inexecutable.