Multimodal portable communication interface for accessing video content

• US 8,259,082 B2
• Filed: 09/12/2008
• Issued: 09/04/2012
• Est. Priority Date: 09/12/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Shahraray, Behzad, Gibbon, David Crawford, Renger, Bernard S., Liu, Zhu, Basso, Andrea, Gilbert, Mazin, Johnston, Michael J.
• Primary Examiner(s): Nguyen, Kevin M
• Assistant Examiner(s): Lee, Jr., Kenneth B
• Application Number:
  US12/283,512
• Publication Number:
  US 20100066684A1
• Time in Patent Office: 1,453 Days
• Field of Search: 345173-184, 178/18.01, 715/700
• US Class Current: 345/173
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/64322 IP

Abstract

A portable communication device has a touch screen display that receives tactile input and a microphone that receives audio input. The portable communication device initiates a query for media based at least in part on tactile input and audio input. The touch screen display is a multi-touch screen. The portable communication device sends an initiated query and receives a text response indicative of a speech to text conversion of the query. The portable communication device then displays video in response to tactile input and audio input.

Claims

1. An apparatus for accessing media comprising:

a touch screen display adapted to receive tactile input;

a microphone adapted to receive audio input; and

a controller adapted to;

transmit a first received audio input to a multimodal portal;

receive extensible markup language text from the multimodal portal based on text conversion of the first received audio input;

parse the extensible markup language text to generate parsed text;

generate a query for video media based on a first received tactile input and the parsed text;

send the query and receive a text response in response to the query, the text response identifying video media based on the first received tactile input and the parsed text of the query;

transmit a request for additional information related to the text response based on a second tactile input;

receive additional information based on the request for additional information;

transmit a command to transmit video to a device in response to a third received tactile input and a second received audio input; and

display a graphical user interface on the touch screen display for controlling display of video via the device.

2. The apparatus of claim 1 wherein the touch screen display is a multi-touch screen.

3. The apparatus of claim 1 wherein the touch screen display is further adapted to display video in response to a received tactile input and a received audio input.

4. A method of accessing media with a portable communication device comprising:

receiving a first audio input indicative of desired video media content from the portable communication device;

transmitting extensible markup text to the portable communication device based on text conversion of the first audio input;

receiving a query for desired video media content, the query comprising parsed text based on the extensible markup text and a first tactile input received at the portable communication device;

querying a database based on the query;

sending a text response related to the query to the portable communication device;

receiving a request for additional information related to the text response based on a second tactile input received at the portable communication device;

transmitting additional information in response to the request for additional information;

receiving a request for display of video media on a display device, the video media related to the additional information;

sending video media related to the additional information to the display device; and

transmitting data for causing display of a graphical user interface on the portable communication device for controlling display of video media on the display device.

5. The method of claim 4 further comprising:

receiving the first audio input at a speech to text converter.

6. A computer readable medium storing computer program instructions for accessing media with a portable communication device, the computer program instructions, which when executed on a processor, cause the processor to perform a method comprising:

receiving a first audio input indicative of desired video media content from the portable communication device;

transmitting extensible markup text to the portable communication device based on text conversion of the first audio input;

receiving a query for desired video media content, the query comprising parsed text based on the extensible markup text and a first tactile input received at the portable communication device;

querying a database based on the query;

sending a text response related to the query to the portable communication device;

receiving a request for additional information related to the text response based on a second tactile input received at the portable communication device;

transmitting additional information in response to the request for additional information;

receiving a request for display of video media on a display device, the video media related to the additional information;

sending video media related to the additional information to the display device; and

transmitting data for causing display of a graphical user interface on the portable communication device for controlling display of video media on the display device.

7. The computer readable medium of claim 6, wherein the method further comprises:

receiving the first audio input at a speech to text converter.