Text data extraction system for interleaved video data streams

• US 6,430,357 B1
• Filed: 09/22/1998
• Issued: 08/06/2002
• Est. Priority Date: 09/22/1998
• Status: Expired due to Term

• Current Assignee: ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Original Assignee: ATI International SRL (Advanced Micro Devices, Inc.)
• Inventors: Orr, Stephen J.
• Primary Examiner(s): TRAN, THAI Q
• Application Number:
  US09/158,623
• Time in Patent Office: 1,414 Days
• Field of Search: H04/N.576, H04/N.708, H04/N.979, 386/1, 386/4, 386/45, 386/46, 386/69, 386/70, 386/111, 386/112, 386/125, 386/126, 386/95, 386/98, 348/460, 348/461, 348/465, 348/468, 348/473, 348/476, 348/478, 348/906, 348/423.1
• US Class Current: 386/244
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G11B 2220/2562 DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

A text data extraction system analyzes one or more interleaved video data streams and parses the stream(s) to extract text data from text data packets. In addition, presentation time data is extracted to facilitate independent use of the text data from corresponding video data. Extracted time coded text data is stored so that the presentation time data can be used to link the extracted text data back to the corresponding video data to facilitate for example: annotation of a movie, text searching of closed caption text, printing transcripts of closed caption text, controlling video playback, such as the order in which scenes are played back, and any other suitable navigation or manipulation of video images or text data.

Claims

1. A text data extraction system for interleaved video data streams having at least text data packets, presentation time data and interleaved video data, comprising:

parsing means for analyzing the interleaved stream and extracting text data from the text data packets and for extracting the presentation time data to facilitate independent use of the text data from corresponding video data; and

means, operatively coupled to the parsing means, for storing extracted text data and the extracted presentation time data such that the presentation time data can be used to link the extracted text data to corresponding video data.

2. The system of claim 1 including means, operatively responsive to the interleaved stream, for linking the interleaved stream to stream identification data.

3. The system of claim 2 wherein the stream identification data includes data representing a digital signature corresponding to a given interleaved stream.

4. The system of claim 2 wherein the stream identification data is embedded in the interleaved stream.

5. The system of claim 1 wherein the text data packets include closed captioned data.

6. The system of claim 1 further including means, responsive to the stored presentation time data, for facilitating navigation among video frames based on the extracted stored presentation time data.

8. The system of claim 1 including means for processing the extracted text data to facilitate text based operations independent of corresponding video data.

9. The system of claim 6 wherein the means for navigating includes means for controlling video playback based on the extracted stored presentation time data such that selected video data is played in response to the stored presentation time data.

10. The system of claim 2 wherein the means for linking includes stream identification data for a plurality of streams and per stream storage identification data representing stored extracted text data and presentation time data for a plurality of streams.

11. The system of claim 9 including user selection means for allowing selection of extracted presentation time data for controlling the means for controlling video playback.

12. The system of claim 1 wherein the means for storing stores the extracted presentation time data such that the extracted presentation time data links the extracted text data to corresponding video data.

13. The system of claim 6 wherein the means for navigating includes means for selectively playing video data based on extracted text data.

14. The system of claim 8 wherein the means for processing employs a text search engine using the extracted text data to produce text based control data.

15. The system of claim 14 wherein the text based control data serves to control an audio level associated with the video data.

16. The system of claim 14 wherein the text based control data controls video playback of the video data.

17. The system of claim 1 further including annotation means for generating annotation data associated with at least one of the extracted text data and the extracted presentation time data.

18. The system of claim 8 including a text translator operatively responsive to the extracted text data.

7. The system of 6 wherein the parsing means continues to parse an entire interleaved stream prior to allowing navigation to occur by the means for navigating.

19. A text data extraction system for interleaved video data streams having at least text data packets, presentation time data and interleaved video data, comprising:

parsing means for analyzing the interleaved stream and extracting text data from the text data packets and for extracting the presentation time data to facilitate independent use of the text data from corresponding video data;

means, operatively coupled to the parsing means, for storing extracted text data and the extracted presentation time data such that the presentation time data can be used to link the extracted text data back to corresponding video data;

means, responsive to the stored presentation time data, for facilitating navigation among video frames based on the extracted stored presentation time data; and

means for processing the extracted text data to facilitate text based operations independent of corresponding video data.

20. The system of claim 19 including means, operatively responsive to the interleaved stream, for linking the interleaved stream to stream identification data.

21. The system of claim 19 wherein the text data packets include closed captioned data.

24. The system of claim 20 wherein the means for linking includes stream identification data for a plurality of streams and per stream storage identification data representing stored extracted text data and presentation time data for a plurality of streams.

25. The system of claim 19 including user selection means for allowing selection of extracted presentation time data for controlling the means for controlling video playback.

26. The system of claim 19 wherein the means for storing stores the extracted presentation time data such that the extracted presentation time data links the extracted test data to corresponding video data.

27. The system of claim 20 wherein the means for navigating includes means for selectively playing video data based on extracted text data.

28. The system of claim 19 wherein the means for processing employs a text search engine using the extracted text data to produce text based control data.

29. The system of claim 28 wherein the text based control data serves to control an audio level associated with the video data.

30. The system of claim 29 wherein the text based control data controls video playback of the video data.

31. The system of claim 19 including annotation means for generating annotation data associated with at least one of the extracted text data and the extracted presentation time data.

32. The system of claim 19 including a text translator operatively responsive to the extracted text data.

22. The system of 20 wherein the parsing means continues to parse an entire interleaved stream prior to allowing navigation to occur by the means for navigating.

23. The system of claim 22 wherein in the means for navigating includes means for controlling video playback based on the extracted stored presentation time data such that selected video data is played in response to the stored presentation time data.

33. A text data extraction method for interleaved video data streams having at least text data packets, presentation time data and interleaved video data, comprising:

analyzing the interleaved stream, extracting text data from the text data packets and extracting the presentation time data to facilitate independent use of the text data from corresponding video data; and

storing the extracted text data and the extracted presentation time data such that the presentation time data can be used to link the extracted text data back to corresponding video data.

34. The method of claim 33 including linking the interleaved stream to stream identification data.

35. The method of claim 34 wherein the stream identification data includes data representing a digital signature corresponding to a given interleaved stream.

36. The method of claim 33 wherein the text data packets include closed captioned data.

37. The method of claim 33 further including the step of navigating among video frames based on the extracted stored presentation time data.

38. The method of claim 37 wherein analyzing includes parsing an entire interleaved stream prior to allowing navigation to occur.

39. The method of claim 37 wherein the step of navigating includes controlling video playback based on the extracted stored presentation time data such that selected video data is played in response to the stored presentation time data.

40. The method of claim 34 wherein linking includes linking stream identification data for a plurality of streams and per stream storage identification data representing stored extracted text data and presentation time data for a plurality of streams.

41. The method of claim 37 wherein navigating includes selectively playing video data based on extracted text data.

42. The method of claim 33 further including generating annotation data associated with at least one of the extracted text data and the extracted presentation time data.

43. The method of claim 33 further including printing interleaved text based on stored extracted text data and corresponding extracted presentation time data.