Displaying text of video in browsers on a frame by frame basis

• US 7,730,390 B2
• Filed: 03/13/2008
• Issued: 06/01/2010
• Est. Priority Date: 04/19/2001
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Dutta, Rabindranath, Schwerdtfeger, Richard Scott, Janakiraman, Janani
• Primary Examiner(s): RIES, LAURIE ANNE
• Application Number:
  US12/047,499
• Publication Number:
  US 20080222084A1
• Time in Patent Office: 810 Days
• Field of Search: 715/273, 715/210, 715/209, 715/854, 345/581
• US Class Current: 715/209
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/440281 by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783
• CPC Class Codes: H04N 21/443 OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80

Abstract

A method, system, and computer program product for presenting text from multimedia data to a user is provided. In one embodiment, multimedia data containing associated text data is received by a data processing system. The associated text data is extracted from the multimedia data. The associated text data is then outputted without outputting moving images from the multimedia data.

Claims

1. A computer program product in a computer readable media for use in a data processing system for presenting text from moving video to a user;

the computer program product comprising;

instructions, stored in the computer readable media, for receiving multimedia data containing a plurality of moving video frames and an associated plurality of sets of text data, wherein the associated plurality of sets of text data are associated in time with the plurality of moving video frames, wherein the plurality of sets of text data includes a first text data set associated with a first plurality of moving video frames of the multimedia data, and a second text data set associated with a second plurality of moving video frames of the multimedia data;

instructions for extracting the associated plurality of sets of text data from the multimedia data;

instructions for extracting a first video frame, from the first plurality of moving video frames, associated with the first text data set to form a first still image;

instructions for extracting a second video frame, from the second plurality of moving video frames, associated with the first text data set to form a second still image;

instructions for outputting the first text data set in association with the first still image; and

instructions for outputting the second text data set in association with the second still image; and

wherein the instructions for extracting the associated plurality of sets of text data from the multimedia comprise instructions for parsing the multimedia data to determine the first text data set and the first video frame of the first plurality of moving video frames and discarding remaining moving video frames from the first plurality of moving video frames.

2. The computer program product as recited in claim 1, wherein the first text data set and the second text data set are presented in association with the first still image and the second still image, respectively, to the user simultaneously.

3. The computer program product as recited in claim 2, wherein the first text data set and the second text data set are presented in association with the first still image and the second still image, respectively, in separate portions of a static display.

4. The computer program product as recited in claim 1, wherein the first text data set and the second text data set are presented in association with the first still image and the second still image, respectively, to the user individually in a sequential order.

5. The computer program product as recited in claim 4, wherein a next set of text data in the sequential order is presented in response to an indication by the user to display the next set of text data.

6. A system for presenting text from moving video to a user;

the system comprising;

a receiver which receives multimedia data containing a plurality of moving video frames and an associated plurality of sets of text data, wherein the associated plurality of sets of text data are associated in time with the plurality of moving video frames, wherein the plurality of sets of text data includes a first text data set associated with a first plurality of moving video frames of the multimedia data, and a second text data set associated with a second plurality of moving video frames of the multimedia data;

a text extraction unit including at least one processor, the text extraction unit being configured to extract the associated plurality of sets of text data from the multimedia data using the at least one processor;

a still image extraction unit which extracts a first video frame, from the first plurality of moving video frames, associated with the first text data set to form a first still image and extracts a second video frame, from the second plurality of moving video frames, associated with the first text data set to form a second still image;

an output unit which outputs the first text data set in association with the first still image and outputs the second text data set in association with the second still image; and

wherein the extraction unit parses the multimedia data to determine the first text data set and the first video frame of the first plurality of moving video frames and discards remaining moving video frames from the first plurality of moving video frames.

7. The system as recited in claim 6, wherein the first text data set and the second text data set are presented in association with the first still image and the second still image, respectively, to the user simultaneously.

8. The system as recited in claim 7, wherein the first text data set and the second text data set are presented in association with the first still image and the second still image, respectively, in separate portions of a static display.

9. The system as recited in claim 6, wherein the first text data set and the second text data set are presented in association with the first still image and the second still image, respectively, to the user individually in a sequential order.

10. The system as recited in claim 9, wherein a next set of text data in the sequential order is presented in response to an indication by the user to display the next set of text data.