Multimodal portable communication interface for accessing video content

• US 8,514,197 B2
• Filed: 08/08/2012
• Issued: 08/20/2013
• Est. Priority Date: 09/12/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Shahraray, Behzad, Gibbon, David Crawford, Renger, Bernard S., Liu, Zhu, Basso, Andrea, Gilbert, Mazin, Johnston, Michael J.
• Primary Examiner(s): Nguyen, Kevin M
• Assistant Examiner(s): Lee, Jr., Kenneth B
• Application Number:
  US13/569,722
• Publication Number:
  US 20120304239A1
• Time in Patent Office: 377 Days
• Field of Search: 345173-184, 715/700
• US Class Current: 345/173
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/64322 IP

Abstract

A portable communication device has a touch screen display that receives tactile input and a microphone that receives audio input. The portable communication device initiates a query for media based at least in part on tactile input and audio input. The touch screen display is a multi-touch screen. The portable communication device sends an initiated query and receives a text response indicative of a speech to text conversion of the query. The portable communication device then displays video in response to tactile input and audio input.

Claims

1. A method for accessing media comprising:

generating a query at a portable communication device, the query for video media and based on a first received tactile input and parsed text based on a first received audio input;

transmitting the query to a multimodal portal;

receiving a text response in response to the query, the text response identifying video media based on the query;

transmitting a request for additional information related to the text response based on a second tactile input;

receiving the additional information based on the request for additional information; and

transmitting a command to transmit video to a device in response to a third tactile input and a second received audio input.

2. The method of claim 1 further comprising:

transmitting the first received audio input to the multimodal portal; and

receiving extensible markup language text from the multimodal portal based on text conversion of the first received audio input.

3. The method of claim 2 further comprising:

parsing the extensible markup text to generate the parsed text.

4. The method of claim 1 further comprising:

displaying a graphical user interface on a touch screen display of the portable communication device for controlling display of video via the device.

5. An apparatus for accessing media comprising:

a touch screen display adapted to receive tactile input;

a microphone adapted to receive audio input;

a memory storing computer program instructions;

a processor communicatively coupled to the touch screen display, the microphone, and the memory, the processor configured to execute the computer program instructions, which, when executed on the processor, cause the processor to perform operations comprising;

generating a query for video media, the query based on a first received tactile input and parsed text based on a first received audio input;

transmitting the query to a multimodal portal;

receiving a text response in response to the query, the text response identifying video media based on the query;

transmitting a request for additional information related to the text response based on a second tactile input;

receiving the additional information based on the request for additional information; and

transmitting a command to transmit video to a device in response to a third tactile input and a second received audio input.

6. The apparatus of claim 5 wherein the operations further comprise:

transmitting the first received audio input to the multimodal portal; and

receiving extensible markup language text from the multimodal portal based on text conversion of the first received audio input.

7. The apparatus of claim 6 wherein the operations further comprise:

parsing the extensible markup text to generate the parsed text.

8. The apparatus of claim 5 wherein the operations further comprise:

displaying a graphical user interface on the touch screen display of the portable communication device for controlling display of video via the device.

9. The apparatus of claim 5 wherein the touch screen display is further adapted to display video in response to a received tactile input and a received audio input.

10. A method of accessing media, the method comprising:

receiving a query for video media at a multimodal portal, the query based on a first tactile input received at a portable communication device and parsed text based on a first audio input received at the portable communication device;

querying a database based on the query;

sending a text response identifying video media, the text response based on results of querying the database;

receiving a request for additional information related to the text response based on a second tactile input received at the portable communication device;

transmitting the additional information based on the request for additional information; and

receiving a command to transmit video to a device in response to a third tactile input and a second audio input.

11. The method of claim 10 further comprising:

receiving the first audio input; and

transmitting extensible markup language text to the portable communications device based on text conversion of the first audio input.

12. The method of claim 10 further comprising:

receiving a command to control display of video via the device.