Subtitle encoding/decoding method and apparatus

• US 5,731,847 A
• Filed: 03/19/1996
• Issued: 03/24/1998
• Est. Priority Date: 03/20/1995
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tsukagoshi, Ikuo
• Primary Examiner(s): HSIA, SHERRIE Y
• Application Number:
  US08/618,515
• Time in Patent Office: 735 Days
• Field of Search: 348/468, 348/472, 348/473, 348/563, 348/564, 348/569, 348/589, 348/600, 348/599
• US Class Current: 348/589
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2220/2545 CDs
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/3063 Subcodes
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 5/278 Subtitling
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 7/0122 the input and the output signals having different aspect ratios
• CPC Class Codes: H04N 7/0885 for the transmission of subtitles
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8063 using time division multiplex of the PCM audio and PCM video signals
• CPC Class Codes: H04N 9/8244 involving the use of subcodes

Abstract

Encoding and decoding of subtitle data is performed in real time. A buffer regulates a flow rate of the subtitle data to ensure that the appropriate subtitles are superimposed with the correct video picture. In encoding, subtitles are generated in correspondence to a video picture. The subtitles are separately encoded and multiplexed with the video picture for transmission. Upon decoding, the subtitles are selected at a time which corresponds to the display of the corresponding video picture. Since the subtitles are processed separately from the video data, the subtitles may be manipulated with great control; thus providing more flexibility in encoding and decoding.

Claims

1. A subtitle data encoding apparatus for generating subtitles to be multiplexed with video pictures by a multiplexer, said apparatus comprising:

subtitle generating means for separately generating said subtitles for superimposition with a respective video picture selected from among said video pictures;

encoding means for encoding said subtitles into encoded subtitle data; and

buffer means for regulating a flow rate of said encoded subtitle data to transfer said encoded subtitle data contemporaneously with said respective video picture to the multiplexer.

2. The subtitle data encoding apparatus of claim 1, wherein the encoding means comprises:

quantization means for quantizing said subtitles to produce quantized subtitle data; and

coding means for compressing said subtitle data quantized by said quantization means.

3. The subtitle data encoding apparatus of claim 2, wherein the coding means comprises:

pulse code modulation means for performing pulse code modulation on the subtitle data quantized by the quantization means;

run-length coding means for performing run-length coding on the subtitle data modulated by the pulse code modulation means; and

variable length coding means for variable length coding said run-length coded subtitle data.

4. The subtitle data encoding apparatus of claim 1 wherein the encoding means includes a quantizer having a quantization level and the buffer means comprises subtitle buffer verifier means for controlling said flow rate of said encoded subtitle data by controlling the quantization level of said encoding means.

5. The subtitle data encoding apparatus of claim 4 further comprising loading block creator means for creating a load block referenced by said subtitle buffer verifier means, wherein said subtitle buffer verifier means assembles headers of information into said load block and transfers the same to the multiplexer for multiplexing with said respective video picture.

6. The subtitle data encoding apparatus of claim 5 further comprising a color look-up table circuit for storing a color look-up table of color components, and wherein said loading block creator means references said color look-up table in creating said load block, and said subtitle buffer verifier means stores said color look-up table in said load block for transfer to said multiplexer.

7. The subtitle data encoding apparatus of claim 1, wherein the subtitle generating means comprises a character generator including a visual display and a keyboard for keying in said subtitles.

8. The subtitle data encoding apparatus of claim 7, wherein said substitle generating means further comprises a flying spot scanner for automatically extracting said subtitles from an external video source.

9. The subtitle data encoding apparatus of claim 6, further comprising color wiping means for performing color wiping of said subtitles.

10. The subtitle data encoding apparatus of claim 9, wherein said color wiping means performs the color wiping by replacing said color look-up table with a color look-up table having a color wiping format.

11. A subtitle data decoding apparatus for decoding encoded subtitles demultiplexed from video pictures by a demultiplexer and for superimposing said subtitles on said video pictures, said apparatus comprising:

buffer means for regulating a flow rate of said encoded subtitles to read out said encoded subtitles contemporaneously with a display of a respective video picture selected from among said video pictures;

decoding means for decoding said encoded subtitles into decoded subtitles; and

mixing means for mixing said decoded subtitles with said respective video picture such that the decoded subtitles are superimposed on the display of said respective video picture.

12. The subtitle data decoding apparatus of claim 11 further comprising detector means for detecting said encoded subtitles supplied in bit streams and selectively forwarding said bit streams to said buffer means according to a reproduction mode of said subtitle data decoding apparatus.

13. The subtitle data decoding apparatus of claim 11, further comprising scheduling means for controlling read/write access to said buffer means by setting a band width of an I/O port of said buffer means, said band width determined by dividing a rate of data demultiplexed by said demultiplexer by said flow rate of said buffer means.

14. The subtitle data decoding apparatus of claim 11, wherein said decoding means comprises:

inverse variable length coding means for decoding said encoded subtitles forwarded from said buffer means by employing inverse variable length coding; and

inverse run-length coding means for decoding said subtitles from said inverse variable length coding means by performing inverse run-length coding.

15. The subtitle data decoding apparatus of claim 14 further comprising a 3:

4 filter for transforming the subtitles decoded by said inverse run-length coding means into a 4;

3 video picture format.

16. The subtitle data decoding apparatus of claim 11 wherein said subtitles are comprised of pixels, and further comprising color look-up table means for generating color components from a color look up table in response to said decoded subtitles, and for determining a mixing ratio for the color components of each pixel in the subtitles, wherein said mixing means mixes said color components according to said mixing ratio with said decoded subtitles.

17. A subtitle data encoding method for generating subtitles to be multiplexed with video pictures by a multiplexer, said method comprising the steps of:

generating said subtitles separately for superimposition with a respective video picture selected from among said video pictures;

encoding said subtitles into encoded subtitle data; and

regulating a flow rate of said encoded subtitle data to transfer said encoded subtitle data contemporaneously with said respective video picture to the multiplexer.

18. The subtitle data encoding method of claim 17, wherein the encoding step further comprises the steps of:

quantizing said subtitles to produce quantized subtitle data; and

compressing said quantized subtitle data.

19. The subtitle data encoding method of claim 18, wherein said compressing step comprises the steps of:

pulse code modulating the quantized subtitle data;

run-length coding the pulse code modulated subtitle data; and

variable length coding said run-length coded subtitle data.

20. The subtitle data encoding method of claim 18 wherein said encoding step comprises controlling said flow rate of said encoded subtitle data by controlling a quantization level at which said subtitle data is quantized.

21. The subtitle data encoding method of claim 20 further comprising:

creating a load block referenced when said flow rate is controlled; and

assembling headers of information into said load block and transferring the same to the multiplexer for multiplexing with said respective video picture.

22. The subtitle data encoding method of claim 21 further comprising:

storing a color look-up table of color components,

referencing said color look-up table when creating said load block; and

storing said color look-up table in said load block for transfer to said multiplexer.

23. The subtitle data encoding method of claim 22, further comprising color wiping said subtitles.

24. The subtitle data encoding method of claim 23, wherein said color wiping comprises replacing said color look-up table with a color look-up table having a color wiping format.

25. The subtitle data encoding method of claim 17, wherein said subtitles are generated by keying in said subtitles from a keyboard and visually displaying said keyed-in subtitles.

26. The subtitle data encoding method of claim 17, wherein said subtitles are generated by automatically extracting said subtitles from an external video source using a flying spot scanner.

27. A subtitle data decoding method for decoding encoded subtitles demultiplexed from video pictures by a demultiplexer and for superimposing said subtitles on said video pictures, said method comprising the steps of:

regulating a flow rate of said encoded subtitles to read out said encoded subtitles from a buffer contemporaneously with a display of a respective video picture selected from among said video pictures;

decoding said encoded subtitles into decoded subtitles; and

mixing said decoded subtitles with said respective video picture such that the decoded subtitles are superimposed on the display of said respective video picture.

28. The subtitle data decoding method of claim 27 further comprising selectively buffering bit streams supplied to said buffer which correspond to a designated reproduction mode.

29. The subtitle data decoding method of claim 28, further comprising scheduling read/write access to said buffer by setting a band width of an I/O port of said buffer, said band width being determined by dividing a rate of data demultiplexed by said demultiplexer by said flow rate of said bit streams.

30. The subtitle data decoding method of claim 27, wherein said decoding step comprises:

inverse variable length coding said subtitles read out from said buffer; and

inverse run-length coding said inverse variable length coded subtitles.

31. The subtitle data decoding method of claim 30 further comprising 3:

4 filtering said inverse run-length coded subtitles into a 4;

3 video picture format.

32. The subtitle data decoding method of claim 27 wherein said subtitles are comprised of pixels, and further comprising:

generating color components from a color look up table in response to said decoded subtitles;

determining a mixing ratio for the color components of each pixel in the subtitles; and

mixing said color components according to said mixing ratio with said decoded subtitles.

33. A subtitle processor for processing subtitle data comprising:

bit stream select means for selecting a respective bit stream of the subtitle data from among a plurality of supplied subtitle data bit streams;

time display stamp means for indicating a time when said selected bit stream is to be decoded;

decode start means for initiating decoding of said selected bit stream at said time indicated by said time display stamp means; and

mixing means for mixing said selected bit stream decoded by said decode start means with video picture data.

34. The subtitle processor for processing subtitle data according to claim 33 further comprising system reset means for resetting said subtitle processor.

35. The subtitle processor for processing subtitle data according to claim 33 further comprising channel select means for selecting a channel carrying different sets of said bit streams, each set representing a different video broadcast.

36. The subtitle processor for processing subtitle data according to claim 33 further comprising buffer clear means for dumping said respective bit stream upon detection of corrupt data.

37. The subtitle processor for processing subtitle data according to claim 33 further comprising special reproduction means for setting the subtitle processor in a special reproduction mode by causing said bit stream select means to select special reproduction bit streams from among said bit streams.

38. The subtitle processor for processing subtitle data according to claim 33 further comprising squeeze means for initiating a 4:

3 conversion of a subtitle picture composed of said bit streams selected by said selected bit stream.

39. The subtitle processor for processing subtitle data according to claim 33 further comprising vertical position means for designating a vertical display position of a subtitle composed of said selected bit stream to said mixing means.

40. The subtitle processor for processing subtitle data according to claim 33 further comprising on/off means for causing said mixing means to selectively display said bit streams as a subtitle picture.

41. The subtitle processor for processing subtitle data according to claim 33 further comprising color look up table means for providing a color look up table, means for generating color components from said subtitle data making up a subtitle picture by referencing said color look up table.