Multimodal portable communication interface for accessing video content

• US 9,348,908 B2
• Filed: 07/19/2013
• Issued: 05/24/2016
• Est. Priority Date: 09/12/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Shahraray, Behzad, Gibbon, David Crawford, Renger, Bernard S., Liu, Zhu, Basso, Andrea, Gilbert, Mazin, Johnston, Michael J.
• Primary Examiner(s): Lee, Jr., Kenneth B
• Application Number:
  US13/946,525
• Publication Number:
  US 20130305301A1
• Time in Patent Office: 1,040 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/64322 IP

Abstract

A portable communication device has a touch screen display that receives tactile input and a microphone that receives audio input. The portable communication device initiates a query for media based at least in part on tactile input and audio input. The touch screen display is a multi-touch screen. The portable communication device sends an initiated query and receives a text response indicative of a speech to text conversion of the query. The portable communication device then displays video in response to tactile input and audio input.

Claims

1. A method for accessing media comprising:

receiving a query for video media at a multimodal portal, the query based on a first tactile input received at a portable communication device and parsed text based on a first audio input received at the portable communication device;

querying a database based on the query;

sending a text response identifying video media, the text response based on results of querying the database; and

receiving a command to transmit video to a device in response to a second tactile input and a second audio input.

2. The method of claim 1 further comprising:

receiving a request for information related to the text response based on a third tactile input received at the portable communication device; and

transmitting the information related to the text response based on the request for information related to the text response.

3. The method of claim 1 further comprising:

receiving the first audio input; and

transmitting extensible markup language text to the portable communications device based on text conversion of the first audio input.

4. The method of claim 3 further comprising:

converting the first audio input to extensible markup language text.

5. The method of claim 1 further comprising:

receiving a command via the portable communication device to control display of video.

6. The method of claim 1 further comprising:

transmitting video to the portable communication device in response to the command including an indication that video should be transmitted to the portable communication device.

7. The method of claim 1 further comprising:

transmitting video to a display separate from the portable communication device in response to the command including an indication that video should be transmitted to the display separate from the portable communication device.

8. An apparatus for accessing media comprising:

a processor; and

a memory to store computer program instructions, the computer program instructions when executed on the processor cause the processor to perform operations comprising;

receiving a query for video media, the query based on a first tactile input received at a portable communication device and parsed text based on a first audio input received at the portable communication device;

querying a database based on the query;

sending a text response identifying video media, the text response based on results of querying the database; and

receiving a command to transmit video to a device in response to a second tactile input and a second audio input.

9. The apparatus of claim 8, the operations further comprising:

receiving a request for information related to the text response based on a third tactile input received at the portable communication device; and

transmitting the information related to the text response based on the request for information related to the text response.

10. The apparatus of claim 8, the operations further comprising:

receiving the first audio input; and

transmitting extensible markup language text to the portable communications device based on text conversion of the first audio input.

11. The apparatus of claim 10, the operations further comprising:

converting the first audio input to extensible markup language text.

12. The apparatus of claim 8, the operations further comprising:

receiving a command via the portable communication device to control display of video.

13. The apparatus of claim 8, the operations further comprising:

transmitting video to the portable communication device in response to the command including an indication that video should be transmitted to the portable communication device.

14. The apparatus of claim 8, the operations further comprising:

transmitting video to a display separate from the portable communication device in response to the command including an indication that video should be transmitted to the display separate from the portable communication device.

15. A computer readable medium storing computer program instructions for accessing media, which, when executed on a processor, cause the processor to perform operations comprising:

receiving a query for video media at a multimodal portal, the query based on a first tactile input received at a portable communication device and parsed text based on a first audio input received at the portable communication device;

querying a database based on the query;

sending a text response identifying video media, the text response based on results of querying the database; and

receiving a command to transmit video to a device in response to a second tactile input and a second audio input.

16. The computer readable medium of claim 15, the operations further comprising:

receiving a request for information related to the text response based on a third tactile input received at the portable communication device; and

transmitting the information related to the text response based on the request for information related to the text response.

17. The computer readable medium of claim 15, the operations further comprising:

receiving the first audio input; and

transmitting extensible markup language text to the portable communications device based on text conversion of the first audio input.

18. The computer readable medium of claim 17, the operations further comprising:

converting the first audio input to extensible markup language text.

19. The computer readable medium of claim 15, the operations further comprising:

receiving a command via the portable communication device to control display of video.

20. The computer readable medium of claim 15, the operations further comprising:

transmitting video to a display separate from the portable communication device in response to the command including an indication that video should be transmitted to the display separate from the portable communication device.