Captioning system

• US 8,248,528 B2
• Filed: 12/23/2002
• Issued: 08/21/2012
• Est. Priority Date: 12/24/2001
• Status: Active Grant

• Current Assignee: Intrasonics SARL
• Original Assignee: Intrasonics SARL
• Inventors: Hosking, Ian Michael, Jones, Aled Wynne, Reynolds, Michael Raymond, Kelly, Peter John, Emmens, Michael David
• Primary Examiner(s): Pendleton, Brian
• Assistant Examiner(s): OKEKE, ONYEDIKA C
• Application Number:
  US10/500,016
• Publication Number:
  US 20050227614A1
• Time in Patent Office: 3,529 Days
• Field of Search: None
• US Class Current: 348/468
• CPC Class Codes: H04N 7/165 Centralised control of user terminal subsequent to an upstream request signal H04N7/17345; Registering at central by two-way working H04N7/17309

Abstract

A captioning system is provided for providing captions for audio and/or video presentations. The captioning system can be used to provide text captions or audio descriptions of a video presentation. A user device is provided for the captioning system having a receiver operable to receive the captions together with synchronization information and a caption output circuit which is operable to output the captions at the appropriate timings defined by the synchronization information. The user device is preferably a portable hand-held device such as a mobile telephone, PDA or the like.

Claims

1. A captioning system for providing captions for a presentation to a user, the presentation including a wireless acoustic signal, the captioning system comprising:

a caption store operable to store one or more sets of captions each set being associated with one or more presentations and each set comprising a plurality of captions for playout at different timings during the associated presentation; and

a cellular telephone having;

i) a first receiver configured to receive, from said caption store, at least one set of captions for storage in the cellular telephone or to receive a sequence of captions for a presentation to be made to a user associated with the cellular telephone;

ii) a microphone configured to receive the wireless acoustic signal of the presentation and to generate a corresponding electrical signal;

iii) a synchronizer configured to process the electrical signal obtained from the microphone corresponding to said acoustic signal of said presentation, to determine synchronization information for use in defining the timing during the presentation at which each caption is to be output to the user associated with the cellular telephone;

iv) a caption output operable to output each received caption to the user associated with the cellular telephone; and

v) a timing controller configured to determine the timing during the presentation at which each caption should be output based on the synchronization information determined by said synchronizer and configured to control said caption output so that each caption is output to said user at the determined timing.

2. A system according to claim 1, wherein said captions include text and wherein said caption output is operable to output said captions to a display device associated with the cellular telephone for display to the user.

3. A system according to claim 2, wherein said captions include formatting information for controlling the format of the text displayed on said display.

4. A system according to claim 2, wherein each caption includes duration information defining the duration that the caption should be displayed to the user.

5. A system according to claim 2, wherein said caption includes timing information defining the time at which the caption should be displayed to the user during the presentation.

6. A system according to claim 1, wherein said presentation includes video.

7. A system according to claim 1, wherein said caption store is formed in a memory card which is insertable into said cellular telephone and wherein said cellular telephone includes a reader for reading captions from said memory card when inserted therein.

8. A system according to claim 1, wherein said caption store is provided in a computer system and wherein said cellular telephone includes a communication module for communicating with said computer system.

9. A system according to claim 8, wherein said computer system is remote from said cellular telephone.

10. A system according to claim 8, wherein said cellular telephone includes a housing and wherein said communication module is provided within said housing.

11. A system according to claim 8, wherein said communication module is operable to communicate with said remote computer system using a wireless communication link.

12. A system according to claim 1, wherein said synchronization information defines time points for one or more predetermined acoustic portions of the presentation.

13. A system according to claim 1, wherein said receiver is configured to receive synchronization data associated with the set of captions, the synchronization data identifying expected time points of one or more predetermined acoustic portions of the presentation and wherein said synchronizer comprises a monitoring circuit operable to monitor said electrical signal obtained from the microphone to identify actual time points of said one or more predetermined acoustic portions of the presentation and wherein said synchronization information generated by said synchronizer comprises a difference between the actual time points identified by the monitoring circuit and the expected time points identified by said synchronization data.

14. A system according to claim 13, wherein said synchronization data associated with the set of captions includes a signature for each of said one or more predetermined acoustic portions of the presentation, wherein said monitoring circuit is configured to process said electrical signal from the microphone and to generate a signature for a current portion of the presentation, wherein the synchronizer further comprises a comparator that is configured to compare the signature generated by the monitoring circuit with a signature of said synchronization data and wherein the cellular telephone has:

a) an acquisition mode of operation in which the signature generated by the monitoring circuit is compared with each of said signatures of said synchronization data to identify a current position within said presentation; and

b) a tracking mode of operation in which the signature generated by said monitoring circuit is compared with an expected one of the signatures of said synchronization data.

15. A system according to claim 14, wherein during said tracking mode of operation, said monitoring circuit is operable to monitor said presentation during a predetermined time window around an expected time point defined by said synchronization data.

16. A system according to claim 13, wherein said cellular telephone is configured to receive said synchronization data from said caption store.

17. A system according to claim 1, wherein said synchronization information is embedded within said acoustic part of the presentation.

18. The system according to claim 17, wherein said synchronization information comprises synchronization codes that have been added to an audio signal of the presentation so that they occur at different timings during the presentation.

19. A system according to claim 18, wherein each synchronization code is unique to uniquely define the position in the presentation.

20. A system according to claim 1, wherein said caption store includes a plurality of sets of captions for a plurality of different presentations.

21. A system according to claim 20, wherein said cellular telephone is configured to process the electrical signal from the microphone corresponding to the acoustic part of the presentation to determine data for use in identifying the presentation therefrom and is configured to transmit the determined data to said caption store and wherein said caption store is configured to use said determined data to identify the presentation being made and to transmit the associated set of captions for the identified presentation to said first receiver.

22. A system according to claim 21, wherein said determined data comprises data characteristic of a captured portion of the acoustic part of the presentation and is configured to transmit said characteristic data to said caption store, and wherein said caption store is operable to use said characteristic data to identify the presentation being made and to transmit the associated set of captions for the identified presentation to the cellular telephone.

23. A system according to claim 1, wherein said presentation is given at a venue, wherein said venue is operable to provide an activation code, wherein said cellular telephone is configured to receive said activation code and further comprises an inhibitor for inhibiting the operation of said caption output unless said cellular telephone has received said activation code.

27. A system according to claim 1, wherein said first receiver is configured to receive said set of captions or said sequence of captions via a telephone network.

28. A system according to claim 1, wherein said first receiver is configured to receive said set of captions or said sequence of captions over a wired communications link in advance of the presentation.

29. A system according to claim 1, wherein said cellular telephone is configured to use said first receiver to download a next caption from said caption store when it detects a synchronization code in the electrical signal received from said microphone that corresponds to the acoustic part of the presentation.

30. A system according to claim 1, wherein said caption store is provided by a remote server.

24. A portable cellular telephone for use in a captioning system, the portable cellular telephone comprising:

i) a first receiver configured to receive, from a caption store, at least one set of captions for storage in the cellular telephone or to receive a sequence of captions for a presentation to be made to a user associated with the cellular telephone;

ii) a microphone configured to receive a wireless acoustic signal that forms part of the presentation and to generate a corresponding electrical signal;

iii) a synchronizer configured to process the electrical signal obtained from the microphone corresponding to said acoustic signal of said presentation, to determine synchronization information for use in defining the timing during the presentation at which each caption is to be output to the user associated with the cellular telephone;

iv) a caption output operable to output each received caption to the user associated with the cellular telephone; and

v) a timing controller configured to determine the timing during the presentation at which each caption should be output based on the synchronization information determined by said synchronizer and configured to control said caption output so that each caption is output to said user at the determined timing.

25. A non-transitory computer readable medium storing computer executable instructions for causing a general purpose computing device to operate as the portable cellular telephone of claim 24.

31. A cellular telephone according to claim 24, wherein said captions include text for display and wherein said captions include formatting information for controlling the format of the displayed text.

32. A cellular telephone according to claim 31, wherein each caption includes duration information defining a duration that the caption should be displayed on said display.

33. A cellular telephone according to claim 31, wherein said caption includes timing information defining the time at which the caption should be displayed to the user during the presentation.

34. A cellular telephone e according to claim 24, wherein said caption store is provided in a remote computer system, wherein said cellular telephone includes a communication module for communicating with said computer system and wherein said first receiver forms part of said communicating means.

35. A cellular telephone according to claim 34, wherein said communication module is configured to communicate with said remote computer system using a wireless communication link.

36. A cellular telephone according to claim 24, configured to receive synchronization data defining the timing during the presentation at which each caption is to be output to the user associated with the cellular telephone and wherein said synchronizer is configured to determine said synchronization information using the received synchronization data and the electrical signal from the microphone.

37. A cellular telephone according to claim 36, wherein said synchronization data defines expected time points for one or more predetermined portions of the presentation.

38. A cellular telephone according to claim 24, wherein said receiver is configured to receive synchronization data associated with the set of captions, the synchronization data identifying expected time points of one or more predetermined acoustic portions of the presentation and wherein said synchronizer comprises comprising a monitoring circuit operable to monitor said electrical signal obtained from the microphone to identify the actual time points of said one or more predetermined acoustic portions of the presentation and wherein said synchronization information generated by said synchronizer comprises a difference between the actual time points identified by the monitoring circuit and the expected time points identified by said synchronization data.

39. A cellular telephone according to claim 38, wherein said synchronization data associated with the set of captions includes a signature for each of said one or more predetermined acoustic portions of the presentation, wherein said monitoring circuit is configured to process said electrical signal from the microphone and to generate a signature for a current portion of the presentation, wherein the synchronizer further comprises a comparator that is configured to compare the signature generated by the monitoring circuit with a signature of said synchronization data and wherein the cellular telephone has:

(a) having an acquisition mode of operation in which the signature generated by said monitoring circuit is compared with each of said signatures of said synchronization data to identify a current position within said presentation; and

(b) a tracking mode of operation in which the signature generated by said monitoring circuit is compared with an expected one of the signatures of said synchronization data.

40. A cellular telephone according to claim 39, wherein during said tracking mode of operation, said monitoring circuit is configured to monitor said presentation during a predetermined time window around an expected time point defined by said synchronization data.

41. A cellular telephone according to claim 24, wherein said synchronization information is embedded within said acoustic part of the presentation and wherein said synchronizer comprises a monitoring circuit configured to monitor the electrical signal from the microphone corresponding to the acoustic part of the presentation and to extract said synchronization information therefrom.

42. A cellular telephone according to claim 41, wherein said synchronization information comprises synchronization codes occurring at different timings during the presentation.

43. A device according to claim 42, wherein each synchronization code is unique to uniquely define the position in the presentation.

44. A cellular telephone according to claim 24, wherein said caption store includes a plurality of sets of captions for a plurality of different presentations and wherein the cellular telephone is configured to process the electrical signal from the microphone corresponding to the acoustic part of the presentation to determine data for use in identifying the presentation therefrom and is configured to transmit the determined data to said caption store for use by the caption store to identify the presentation being made.

45. A cellular telephone according to claim 44, wherein the determined data comprises data characteristic of a captured portion of the acoustic part of the presentation and configured to transmit said characteristic data to said caption store for use by the caption store to identify the presentation.

26. A captioning system for providing captions for a presentation to a user, the presentation including a wireless acoustic signal, the captioning system comprising:

means for storing one or more sets of captions each set being associated with one or more presentations and each set comprising a plurality of captions for play out at different timings during the associated presentation; and

a portable cellular telephone having;

i) means for receiving at least one set of captions for storage in the cellular telephone or for receiving a sequence of captions for a presentation to be made to a user associated with the cellular telephone;

ii) means for receiving the wireless acoustic signal of the presentation and to generate a corresponding electrical signal;

iii) a synchronizer configured to process the electrical signal obtained from the microphone corresponding to said acoustic signal of said presentation, to determine synchronization information for use in defining the timing during the presentation at which each caption is to be output to the user associated with the cellular telephone;

iv) means for outputting each received caption to the user associated with the cellular telephone; and

v) means for determining the timing during the presentation at which each caption should be output based on the synchronization information determined by said synchronizer and for controlling said output means so that each caption is output to said user at the determined timing.

46. A method of providing captions for a presentation to a user, the presentation including a wireless acoustic signal and the method comprising:

storing, at a caption store, one or more sets of captions each being associated with one or more presentations and each comprising a plurality of captions for playout at different timings during the associated presentation; and

at a portable cellular telephone;

using a first receiver to receive, from said caption store, at least one set of captions for storage in the cellular telephone or to receive a sequence of captions for a presentation to be made to an associated user;

using a microphone to receive the wireless acoustic signal of the presentation and to generate a corresponding electrical signal;

processing the electrical signal obtained from the microphone corresponding to said acoustic signal of said presentation, to determine synchronization information for use in defining the timing during the presentation at which each caption is to be output to the user;

outputting the captions to the associated user; and

determining the timing during the presentation at which each caption should be output based on the determined synchronization information and controlling the outputting step so that each caption is output to the user at the determined timing.