Multimodal portable communication interface for accessing video content

• US 9,942,616 B2
• Filed: 05/02/2016
• Issued: 04/10/2018
• Est. Priority Date: 09/12/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Shahraray, Behzad, Gibbon, David Crawford, Renger, Bernard S., Liu, Zhu, Basso, Andrea, Gilbert, Mazin, Johnston, Michael J.
• Primary Examiner(s): Lee, Jr., Kenneth B
• Application Number:
  US15/143,844
• Publication Number:
  US 20160249107A1
• Time in Patent Office: 708 Days
• Field of Search: None
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/64322 IP

Abstract

A portable communication device has a touch screen display that receives tactile input and a microphone that receives audio input. The portable communication device initiates a query for media based at least in part on tactile input and audio input. The touch screen display is a multi-touch screen. The portable communication device sends an initiated query and receives a text response indicative of a speech to text conversion of the query. The portable communication device then displays video in response to tactile input and audio input.

Claims

1. A method comprising:

receiving, by a system including a processor, a content query that is based on a first tactile input and a first audio input captured by a portable communication device;

querying, by the system, a database based on the content query;

sending, by the system, a response identifying a media content, the response based on results of the querying the database;

receiving, by the system, a request for information related to the response based on a second tactile input captured by the portable communication device; and

transmitting, by the system, the information to the portable communication device responsive to the request for information.

2. The method of claim 1, further comprising transmitting, by the system, a video responsive to receiving a command that is based on a third tactile input and a second audio input captured by the portable communication device.

3. The method of claim 1, wherein the first audio input captured by the portable communication device is parsed into a parsed text.

4. The method of claim 1, wherein the response is a text response.

5. The method of claim 1 further comprising:

receiving, by the system, the first audio input; and

transmitting, by the system, an extensible markup language text to the portable communication device based on the first audio input.

6. The method of claim 1, further comprising receiving, by the system, a command via the portable communication device to control display of a video.

7. The method of claim 6, further comprising transmitting, by the system, the video to the portable communication device in response to a determination that the command includes an indication that the video is to be transmitted to the portable communication device.

8. The method of claim 6, further comprising transmitting, by the system, the video to a display separate from the portable communication device in response to a determination that the command includes an indication that the video is to be transmitted to the display separate from the portable communication device.

9. An apparatus comprising:

a processor; and

a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, the operations comprising;

receiving a content query that is based on a first tactile input and a first audio input captured by a portable communication device;

sending a response identifying a media content, the response based on results obtained from a database according to the content query; and

receiving a command to transmit a video, associated with the media content that is identified, wherein the command is based on a second tactile input and a second audio input captured by the portable communication device.

10. The apparatus of claim 9, wherein the operations further comprise:

receiving a request for information related to the response; and

transmitting the information in response to the request for information.

11. The apparatus of claim 10, wherein the request for information is based on a third tactile input captured by the portable communication device.

12. The apparatus of claim 9, wherein the operations further comprise:

receiving the first audio input; and

transmitting an extensible markup language text to the portable communication device based on text conversion of the first audio input.

13. The apparatus of claim 9, wherein the operations further comprise receiving another command via the portable communication device to control display of the video.

14. The apparatus of claim 9, wherein the command is to transmit the video to the portable communication device.

15. The apparatus of claim 9, wherein the command is to transmit the video to a display separate from the portable communication device.

16. A machine-readable storage medium, comprising executable instructions that, when executed by a processor associated with a multimodal portal, facilitate performance of operations, the operations comprising:

receiving a content query that is based on a first tactile input and a first audio input captured by a portable communication device;

sending a response identifying a media content, the response based on results obtained from a database according to the content query;

receiving a request for information related to the response based on a second tactile input captured by the portable communication device; and

transmitting the information responsive to the request for information.

17. The machine-readable storage medium of claim 16, wherein the operations further comprise transmitting a video to a device responsive to receiving a command that is based on a third tactile input and a second audio input captured by the portable communication device.

18. The machine-readable storage medium of claim 16, wherein the operations further comprise:

receiving the first audio input; and

transmitting an extensible markup language text to the portable communication device based on the first audio input.

19. The machine-readable storage medium of claim 16, wherein the operations further comprise transmitting a video to the portable communication device in response to a determination that a received command includes an indication that the video is to be transmitted to the portable communication device.

20. The machine-readable storage medium of claim 16, wherein the operations further comprise transmitting a video to a display separate from the portable communication device in response to a determination that a received command includes an indication that the video is to be transmitted to the display separate from the portable communication device.