Universal closed caption portable receiver

• US 7,221,405 B2
• Filed: 01/31/2001
• Issued: 05/22/2007
• Est. Priority Date: 01/31/2001
• Status: Active Grant

• Current Assignee: Rakuten Group, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Basson, Sara H., Kanevsky, Dimitri
• Primary Examiner(s): LEE, MICHAEL
• Application Number:
  US09/774,930
• Publication Number:
  US 20020101537A1
• Time in Patent Office: 2,302 Days
• Field of Search: 348/468, 348/115, 348/725, 348/731, 348/563, 348/553, 348/552, 345 7- 9
• US Class Current: 348/468
• CPC Class Codes: G09B 19/08 Printed or written appliances, e.g. text books, bilingual letter assemblies, charts
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/41415 involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/4363 Adapting the video stream to a specific local network, e.g. a Bluetooth® network
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
• CPC Class Codes: H04N 21/4856 for language selection, e.g. for the menu or subtitles
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 5/38 Transmitter circuitry for the transmission of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 5/7491 of head mounted projectors
• CPC Class Codes: H04N 7/0885 for the transmission of subtitles
• CPC Class Codes: H04N 7/16 Analogue secrecy systems; Analogue subscription systems
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

Methods and apparatus for portable and universal receipt of closed captioning services by a user are provided in accordance with the invention. The invention permits a user to receive closed captioning services wherever he or she may be viewing video content with an audio component in accordance with a video/audio content display system (e.g., television set, computer monitor, movie theater), regardless of whether the content display system provides closed captioning capabilities. Also, the invention permits a user to receive closed captioning services independent of the video/audio content display system that they are using to view the video content. In one illustrative aspect of the present invention, a portable and universal closed caption receiving device (closed caption receiver) is provided for: (i) receiving a signal, which includes closed captions, from a closed caption provider while the user watches a program on a video/audio content display system; (ii) extracting the closed captions; and (iii) providing the closed captions to a head mounted display for presentation to the user so that the user may view the program and, at the same time, view the closed captions in synchronization with the video content of the program.

Claims

1. A method of processing a signal wherein at least a portion of the signal includes one or more closed captions representing audio content associated with a program whose visual content is being viewed by a user, the method comprising the steps of:

obtaining, directly from an originating source, the signal including the one or more closed captions in a portable processing device;

autonomously processing the signal in the portable processing device so as to generate a display signal representative of the one or more closed captions in the obtained signal; and

providing the display signal from the portable processing device to a portable display, operatively coupled to the device, for presentation to the user so that the user may view the visual content of the program and view the one or more closed captions in accordance with the portable display;

wherein the portable processing device further comprises an input controller operatively coupled to the processor for allowing the user to enter one or more instructions to the processing device, and a microphone operatively coupled to the processor for allowing the user to enter one or more voice-based instructions to the processing device;

and further wherein at least one of the one or more instructions comprises a channel selection instruction.

2. The method of claim 1, wherein the visual content of the program is presented on a content display system and the portable processing device and the portable display are independent of the content display system.

3. The method of claim 2, wherein the content display system is one of a television set, a computer display, and a movie theater screen.

4. The method of claim 1, wherein the closed captions presented to the user on the portable display are substantially synchronized wit the visual content of the program being viewed by the user.

5. The method of claim 1, wherein the obtaining step comprises receiving the signal including the one or more closed captions from a transcription service.

6. The method of claim 5, wherein the transcription service is configured to prestore transcriptions corresponding to audio content associated with programs, generate a signal including one or more closed captions from a requested transcription, and transmit the signal to the portable processing device.

7. The method of claim 5, wherein the transcription service is configured to generate a transcription associated with a program in real-time upon request, generate a signal including one or more closed captions from the real-time transcription, and transmit the signal to the portable processing device.

8. The method of claim 7, wherein the real-time transcription is generated via at least one of a human stenographer, an automatic speech recognition system, and real-time alignment of a prestored transcription.

9. The method of claim 5, wherein the transcription service is configured to provide the closed captions in one or more different languages.

10. The method of claim 1, wherein the obtaining step comprises receiving the signal including the one or more closed captions from a closed caption translation service.

11. The method of claim 10, wherein the obtained signal is a broadcast television signal.

12. The method of claim 11, wherein the visual content of the program is presented on a television set and the broadcast television signal is obtained from the closed caption translation service via redirection from the television set.

13. The method of claim 1, wherein the portable display is ahead mounted display system.

14. The method of claim 1, wherein the portable device and the source are in communication via one of a wired link and a wireless link.

45. The method of claim 11, wherein the broadcast television signal is selectable with the portable processing device.

46. The method of claim 45, wherein the portable processing device extracts a caption corresponding to the selected broadcast signal.

48. The method of claim 7, wherein the transcription service synchronizes the one or more closed captions from the real-time transcription through a telephone.

49. The method of claim 4, wherein the step of substantially synchronizing the closed captions comprises the step of hierarchically indexing a playing time of the program.

50. The method of claim 10, wherein the closed caption translation service provides a situational description of the program.

15. Apparatus for processing a signal wherein at least a portion of the signal includes one or more closed captions representing audio content associated with a program whose visual content is being viewed by a user, the apparatus comprising:

a portable processing device including at least one processor operative to;

(i) obtain, directly from an originating source, the signal including the one or more closed captions; and

(ii) autonomously process the signal so as to generate a display signal representative of the one or more closed captions in the obtained signal; and

a portable display operatively coupled to the portable processing device and operative to receive and present the display signal to the user so that the user may view the visual content of the program and view the one or more closed captions in accordance with the portable display;

wherein the portable processing device further comprises an input controller operatively coupled to the processor for allowing the user to enter one or more instructions to the processing device, and a microphone operatively coupled to the processor for allowing the user to enter one or more voice-based instructions to the processing device;

and further wherein at least one of the one or more instructions comprises a channel selection instruction.

16. The apparatus of claim 15, wherein the visual content of the program is presented on a content display system and the portable processing device and the portable display are independent of the content display system.

17. The apparatus of claim 16, wherein the content display system is one of a television set, a computer display, and a movie theater screen.

18. The apparatus of claim 15, wherein the closed captions presented to the user on the portable display are substantially synchronized with the visual content of the program being viewed by the user.

19. The apparatus of claim 15, wherein the obtaining operation comprises receiving the signal including the one or more closed captions from a transcription service.

20. The apparatus of claim 19, wherein the transcription service is configured to prestore transcriptions corresponding to audio content associated with programs, generate a signal including one or more closed captions from a requested transcription, and transmit the signal to the portable device.

21. The apparatus of claim 19, wherein the transcription service is configured to generate a transcription associated with a program in real-time upon request, generate a signal including one or more closed captions from the real-time transcription, and transmit the signal to the portable device.

22. The apparatus of claim 21, wherein the real-time transcription is generated via at least one of a human stenographer, an automatic speech recognition system, and real-time alignment of a prestored transcription.

23. The apparatus of claim 19, wherein the transcription service is configured to provide the closed captions in one or more different languages.

24. The apparatus of claim 15, wherein the obtaining operation comprises receiving the signal including the one or more closed captions from a closed caption translation service.

25. The apparatus of claim 24, wherein the obtained signal is a broadcast television signal.

26. The apparatus of claim 25, wherein the visual content of the program is presented on a television set and the broadcast television signal is obtained from the closed caption translation service via redirection from the television set.

27. The apparatus of claim 15, wherein the portable display is a head mounted display system.

28. The apparatus of claim 15, wherein the portable processing device and the source are in communication via one of a wired link and a wireless link.

29. The apparatus of claim 28, wherein the portable processing device further comprises a communication module for providing an interface for the communication link.

47. The apparatus of claim 15, wherein the microphone operatively coupled to the processor captures an audio signal, and further wherein the audio signal is transcribed by a remote-transcription service.

30. A closed captioning system, comprising:

a closed caption receiver configured to be carried by a user including;

a portable processing device including at least one processor operative to;

(i) obtain, directly from an originating closed caption service system, a signal including one or more closed captions representing audio content associated with a program whose visual content is being viewed by the user; and

(ii) autonomously process the signal so as to generate a display signal representative of the one or more closed captions in the obtained signal; and

a portable display operatively coupled to the portable processing device and operative to receive and present the display signal to the user so that the user may view the visual content of the program and view the one or more closed captions in accordance with the portable display; and

a closed caption service system, operatively coupled to the closed caption receiver, including at least one processor operative to;

(i) generate the signal including the one or more closed captions; and

(ii) provide the signal to the closed caption receiver;

wherein the portable processing device further comprises an input controller operatively coupled to the processor for allowing the user to enter one or more instructions to the processing device, and a microphone operatively coupled to the processor for allowing the user to enter one or more voice-based instructions to the processing device;

and further wherein at least one of the one or more instructions comprises a channel selection instruction.

31. The system of claim 30, wherein the visual content of the program is presented on a content display system and the closed caption receiver is independent of the content display system.

32. The system of claim 31, wherein the content display system is one of a television set, a computer display, and a movie theater screen.

33. The system of claim 30, wherein the closed captions presented to the user on the portable display are substantially synchronized, at the closed caption service system, with the visual content of the program being viewed by the user.

34. The system of claim 30, wherein the closed caption service system comprises a transcription service.

35. The system of claim 34, wherein the transcription service is configured to prestore transcriptions corresponding to audio content associated with programs, generate a signal including one or more closed captions from a requested transcription, and transmit the signal to the closed caption receiver.

36. The system of claim 34, wherein the transcription service is configured to generate a transcription associated with a program in real-time upon request, generate a signal including one or more closed captions from the real-time transcription, and transmit the signal to the closed caption receiver.

37. The system of claim 36, wherein the real-time transcription is generated via at least one of a human stenographer, an automatic speech recognition system, and real-time alignment of a prestored transcription.

38. The system of claim 34, wherein the transcription service is configured to provide the closed captions in one or more different languages.

39. The system of claim 30, wherein the closed caption service system comprises a translation service.

40. The system of claim 39, wherein the obtained signal by the closed caption receiver is a broadcast television signal.

41. The system of claim 40, wherein the visual content of the program is presented on a television set and the broadcast television signal is obtained from the translation service by the closed caption receiver via redirection from the television set.

42. The system of claim 30, wherein the portable display is a head mounted display system.

43. The system of claim 30, wherein the closed caption receiver and the closed caption service system are in communication via one of a wired link and a wireless link.

44. The system of claim 43, wherein the portable processing device further comprises a communication module for providing an interface for the communication link.