Method and system for encoding data in the horizontal overscan portion of a video signal

• US 6,742,188 B1
• Filed: 06/30/1997
• Issued: 05/25/2004
• Est. Priority Date: 02/04/1997
• Status: Expired due to Term

• Current Assignee: Musicqubed Innovations LLC (Ascend Innovation Management, LLC)
• Original Assignee: Microsoft Corporation
• Inventors: Del Castillo, Leonardo
• Primary Examiner(s): Srivastava, Vivek
• Assistant Examiner(s): VU, NGOC K
• Application Number:
  US08/885,385
• Time in Patent Office: 2,521 Days
• Field of Search: 725/133, 725/136, 725/141, 725/153, 348/552, 348/473, 348/460, 446/330, 446/408, 434/393, 340/825.52, 340/825.24, 340/825.25, 370/389, 370/351, 370/392
• US Class Current: 725/153
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 30/04 using wireless transmission
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G10H 1/0083 using wireless transmission, e.g. radio, light, infrared
• CPC Class Codes: G10H 2240/311 MIDI transmission G10H2240/056 takes precedence
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: H04L 61/5038 for local use, e.g. in LAN or USB networks, or in a controller area network [CAN]
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04W 28/06 Optimizing the usage of the radio link, e.g. header compression, information sizing , discarding information system modifying transmission characteristic according to link quality by modifying frame length H04L1/0007; dynamic adaptation of the packet size for flow control or congestion control H04L47/365
• CPC Class Codes: H04W 8/26 Network addressing or numbering for mobility support

Abstract

A method and system for encoding control data into the horizontal overscan area of a video signal. Because the control data is concatenated with the video signal on a line-by-line basis, the control data is temporarily synchronized with the underlying video signal. This permits the controlled devices, such as wireless mechanical characters, behave as characters in a scene defined by the programming information of the video signal. A protocol is defined for the encoded data that is addressable, forwardly compatible, error tolerant, and feasible to deploy in connection with a system that is primarily intended to be a children'"'"'s entertainment product. The bandwidth of the communication link defined by the encoded data is adjustable to meet the cost and performance needs of a wide variety of consumers. Sufficient bandwidth is available to control several devices and to provide additional advertising, subscription, or emergency warning services, such as e-mail, foreign language subtitling, intercom capability, telephone pages, weather warnings, configuration data for a set-top box, and so forth.

Claims

1. A method for encoding control data in a video signal defining a plurality of frames, each frame comprising a plurality of lines, comprising the steps of:

concatenating encoded data with the lines of the video signal to create an encoded video signal, such that the encoded data are included within the plurality of frames that define the video signal, and are not concatenated with either of;

portions of the video signal corresponding to a vertical blanking interval, and

portions of the video signal corresponding to a visible raster; and

configuring the encoded data to define signal detection data comprising a plurality of data bits and content data in association with each frame, the content data comprising a plurality of content words, each content word comprising a plurality of data bits and a plurality of error correction bits defining a correction sequence that enables errors in the data bits to be detected and corrected, the content data defining;

a first address associated with a first device;

device-specific control data for the first device;

a second address associated with a second device; and

device-specific control data for the second device.

2. The method of claim 1, further comprising the steps of:

in response to the first address, routing the specific control data for the first device to the first device;

controlling actions of the first device in accordance with the device-specific control data for the first device;

in response to the second address, routing the specific control data for the second device to the second device;

controlling actions of the second device in accordance with the device-specific control data for the second device.

3. The method of claim 2, wherein:

the video signal defines programming information comprising a scene displayed on a display device; and

the device-specific control data for the first device includes voice data and motor control data that causes the first device to behave as a character in the scene displayed on the display device.

4. The method of claim 3, wherein the device-specific control data for the second device comprises at least one of the following:

voice data that cause the second device to behave as a second character in the scene displayed on the display device;

motor control data that cause the second device to behave as a second character in the scene displayed on the display device receiving the encoded video signal from the video data encoder;

electronic mail for a transmission to a computer system;

intercom information for transmission to an intercom system;

telephone paging information for transmission to a paging system;

language translation data displayed on the display device;

advertising information displayed on the display device;

subscription information displayed on the display device; and

emergency warning information displayed on the display device.

5. The method of claim 4, wherein the first address comprises a first start-packet short address word and the second address comprises a second start-packet short address word, further comprising the step of:

interpreting the second start-packet short address as a first end-packet short address word for the first device.

6. The method of claim 4, wherein the first address comprises a start-packet begin-long-address word, further comprising the step of configuring the content data to define:

a first occurrence of a long address word associated with the first device;

a start-packet end-long-address word associated with the first device; and

device-specific control data for the first device.

7. The method of claim 1, wherein the signal detection data comprises at least one signal detection word, each signal detection word comprising:

the plurality of data bits, and

a plurality of error correction bits defining a correction sequence that allows a single-bit error in the data bits to be detected and corrected.

8. The method of claim 7, wherein:

the video signal comprises a plurality of two-field interlaced frames; and

the encoded data of each field of the video signal defines a signal detection word consisting essentially of four data bits and three error correction bits.

9. The method of claim 1, wherein each content word consists essentially of nine data bits and seven error correction bits.

10. The method of claim 1, further comprising the step of:

configuring the encoded data to define signal detection data comprising a signal detection word encoded into each of a plurality of the frames of the video signal; and

a consecutive series of signal detection words defines a dynamic validation sequence in which each signal detection word varies in at least two bits from the immediately preceding signal detection word.

11. The method of claim 10, wherein the dynamic validation sequence comprises the binary representation of 8, 1, 10, 3, 12, 5, 14, 7.

12. The method of claim 1, wherein:

the encoded data comprises a plurality of line signals; and

each line signal is located in the horizontal overscan portion of one of the lines of the video signal.

13. The method of claim 12, wherein each line of the video signal comprises a color burst portion and a visible raster portion, and wherein each line signal comprises a pulse located between the color burst portion and the visible raster portion.

14. The method of claim 13, wherein each pulse defines a single bit of the encoded data.

15. The method of claim 14, wherein:

the video signal comprises a plurality of two-field interlaced frames; and

the encoded data of each field of the video signal defines a 7-bit signal detection word and 13 16-bit content words.

16. The method of claim 13, wherein each pulse is modulated to define a plurality of bits of the encoded data.

17. The method of claim 12, wherein each line of the video signal comprises a color burst portion, a visible raster portion, and a horizontal blanking interval, and wherein each line signal comprises:

a pre-visible pulse located between the color burst portion and the visible raster portion; and

a post-visible pulse located after the visible raster portion and before the horizontal blanking interval.

18. The method of claim 17, wherein:

each pre-visible pulse defines a single bit of the encoded data; and

each post-visible pulse defines a single bit of the encoded data.

19. The method of claim 17, wherein:

each pre-visible pulse is modulated to define a plurality of bits of the encoded data; and

each post-visible pulse is modulated to define a plurality of bits of the encoded data.

20. A storage medium including a computer program which, when executed by a computer-based video data encoder, causes the video data encoder to perform the steps of:

receiving a video signal defining a plurality of frames, each frame comprising a plurality of lines, the video signal defining programming information; and

concatenating encoded data with a plurality of the lines of a plurality of the frames of the video signal to create an encoded video signal;

the encoded data defining content data in association with each frame;

the content data defining;

a first start-packet short address word associated with a first device, the first start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address;

device-specific control data for causing the first device to behave as a character in a scene defined by the programming information;

a second start-packet short address word associated with a second device, the second start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address; and

device-specific control data for the second device; and

transmitting the encoded video signal to a receiving device.

21. The storage medium of claim 20, wherein the content data further defines:

a start-packet start-long-address word associated with a third device;

a long address word associated with the third device;

a start-packet end-long-address word associated with the third device; and

device-specific control data for the third device.

22. The storage medium of claim 20, wherein:

the encoded data defines signal detection data comprising a signal detection word encoded into each of a plurality of the frames of the video signal; and

a consecutive series of the signal detection words defines a dynamic validation sequence in which each signal detection word varies in at least two bits from the immediately preceding signal detection word.

23. The storage medium of claim 20, wherein the encoded data comprises a plurality of line signals wherein each line signal is inserted in the horizontal overscan portion of a line of the video signal.

24. The storage medium of claim 20, wherein:

the content data comprises a plurality of content words and the signal detection data comprises a plurality of signal detection words, each signal detection word and each content word comprising;

a plurality of data bits, and

a plurality of error correction bits defining a correction sequence that allows errors in the data bits to be detected and corrected.

25. A system for encoding data in association with a video signal, comprising a video data encoder functionally connected to a video source and operative for:

receiving a video signal from the video source, the video signal defining a plurality of frames, each frame comprising a plurality of lines, at least part of the video signal corresponding to a visible raster portion of the video signal comprising data used to generate a picture on a display;

concatenating encoded data with a plurality of the lines of a plurality of the frames of the video signal to create an encoded video signal, such that the encoded data are not concatenated with portions of the video signal corresponding to a vertical blanking interval;

the encoded data defining a signal detection word and at least one content word in association with each of a plurality of frames; and

the content words defining;

a first start-packet short address word associated with a first device;

device-specific control data for the first device;

a second start-packet short address word associated with a second device; and

device-specific control data for the second device.

26. The system of claim 25, wherein:

the video signal defines programming information; and

the device-specific control data for the first device causes the first device to behave as a character in a scene defined by the programming information.

27. The system of claim 26, wherein the encoded data comprises a plurality of line signals wherein each line signal is located in the horizontal overscan portion of a line of the video signal.

28. The system of claim 27, wherein each line of the video signal comprises a color burst portion and a visible raster portion, and wherein each line signal comprises a pulse located between the color burst portion and the visible raster portion.

29. The system of claim 28, wherein each pulse defines a single bit of the encoded data.

30. The system of claim 29, wherein:

the video signal comprises a plurality of two-field interlaced frames; and

the encoded data of each field of the video signal defines a signal detection word and thirteen content words.

31. The system of claim 30, wherein each pulse is modulated to define a plurality of bits of the encoded data.

32. The system of claim 30, wherein each line of the video signal comprises a color burst portion, a visible raster portion, and a horizontal blanking interval, and wherein each line signal comprises:

a pre-visible pulse located between the color burst portion and the visible raster portion; and

a post-visible pulse located after the visible raster portion and before the horizontal blanking interval.

33. The system of claim 32, wherein:

each pre-visible pulse defines a single bit of the encoded data; and

each post-visible pulse defines a single bit of the encoded data.

34. The system of claim 32, wherein:

each pre-visible pulse is modulated to define a plurality of bits of the encoded data; and

each post-visible pulse is modulated to define a plurality of bits of the encoded data.

35. The system of claim 25, further comprising a data decoder functionally connected to the video data encoder and operative for:

receiving the encoded video signal from the video data encoder;

detecting the presence of the signal detection word;

extracting the content data from the encoded video signal; and

assembling the content data into a serial data communication signal.

36. The system of claim 35, further comprising a data error processor functionally connected to the data decoder and operative for:

receiving the serial data communication signal from the data decoder;

parsing the serial data communication signal into data bits and error correction bits;

analyzing the error correction bits to detect errors in the data bits;

encoded video signal from the video data encoder;

correcting detected errors in the data bits; and

assembling the corrected data bits into an error corrected data stream.

37. The system of claim 36, further comprising a protocol handler functionally connected to the data error processor and operative for:

receiving the corrected data stream;

detecting the first start-packet short address word associated with a first device;

in response to detecting the first start-packet short address word associated with the first device, beginning the routing of subsequently received device-specific control data to the first device;

detecting the second start end-packet short address word associated with the second device;

in response to detecting the second start end-packet short address word associated with the second device,

discontinuing the routing of subsequently received device-specific control data to the first device, and

beginning the routing of subsequently received device-specific control data to the second device.

38. The system of claim 37, wherein the protocol handler is further operative for:

detecting a start-packet start-long-address word;

detecting a first occurrence of a long address associated with a third device;

detecting a start-packet end-long-address word;

beginning the routing of subsequently received device-specific control data to the third device;

detecting a further address word; and

in response to detecting the further address word, discontinuing the routing of subsequently received device-specific control data to the third device.

39. The system of claim 38, wherein the device-specific control data for the first, second and third devices are selected from the following:

voice data for transmission to a controlled device, the voice data configured to cause the controlled device to behave as a character in a scene defined by programming information defined by the video signal;

motor control data for transmission to a controlled device, the motor control data configured to cause the controlled device to behave as a second character in a scene defined by programming information defined by the video signal;

electronic mail for a transmission to a computer system;

intercom information for transmission to an intercom system;

telephone paging information for transmission to a paging system;

language translation data displayed on a display device;

advertising information displayed on a display device;

subscription information displayed on a display device; and

emergency warning information displayed on a display device.

40. A method for encoding control data in a video signal defining a plurality of frames, each frame comprising a plurality of lines, comprising the steps of:

concatenating encoded data with the lines of the video signal to create an encoded video signal, such that the data is entirely encoded within the plurality of frames; and

configuring the encoded data to define;

a signal detection word comprising a plurality of error correction bits defining a correction sequence that allows a single-bit error in the data bits to be detected and corrected; and

at least one content word in association with each frame, wherein content words define;

a first address associated with a first device, wherein the first device comprises a controller;

device-specific control data for the first device;

a second address associated with a second device, wherein the second device comprises a controlled device that does not display data from the video signal; and

device-specific control data for the second device.

41. A system for encoding data in association with a video signal, comprising a video data encoder functionally connected to a video source and operative for:

receiving a video signal from the video source, the video signal defining a plurality of frames, each frame comprising a plurality of lines;

concatenating encoded data with a plurality of the lines of a plurality of the frames of the video signal to create an encoded video signal;

the encoded data defining a signal detection word and at least one content word in association with each of a plurality of frames; and

wherein content words define;

a first start-packet short address word associated with a first device, the first start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address, wherein the first device comprises a controller;

device-specific control data for the first device;

a second start-packet short address word associated with a second device, the second start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address, wherein the second device comprises a controlled device that does not display data from the video signal; and

device-specific control data for the second device.

42. A storage medium including a computer program which, when executed by a computer-based video data encoder, causes the video data encoder to perform the steps of:

receiving a video signal defining a plurality of frames, each frame comprising a plurality of lines, the video signal defining programming information; and

concatenating encoded data with a plurality of the lines of a plurality of the frames of the video signal to create an encoded video signal, such that the encoded data is not concatenated with either of;

portions of the video signal corresponding to a vertical blanking interval; and

portions of the video signal corresponding to a visible raster;

the encoded data defining content data in association with each frame; and

the content data defining;

a first start-packet short address word associated with a first device, the first start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address;

device-specific control data for the first device;

a second start-packet short address word associated with a second device, the second start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address; and

device-specific control data for the second device.

43. A storage medium including a computer program which, when executed by a computer-based video data encoder, causes the video data encoder to perform the steps of:

receiving a video signal defining a plurality of frames, each frame comprising a plurality of lines, the video signal defining programming information;

concatenating encoded data with a plurality of the lines of a plurality of the frames of the video signal to create an encoded video signal;

the encoded data defining content data in association with each frame; and

the content data defining;

a first start-packet short address word associated with a first device, the first start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address, wherein the first device comprises a controller;

device-specific control data for the first device;

a second start-packet short address word associated with a second device, the second start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address, wherein the second device comprises a controlled device that does not display data from the video signal; and

device-specific control data for the second device.

44. A method for encoding control data in a video signal defining a plurality of frames, each frame comprising a plurality of lines, comprising the steps of:

concatenating encoded data with the lines of the video signal to create an encoded video signal, such that the encoded data is entirely contained within the plurality of frames defining the video signal;

configuring the encoded data to define content data in association with each frame; and

the content data defining;

a first start-packet short address word associated with a first device, the first start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address;

device-specific control data for the first device;

a second start-packet short address word associated with a second device, the second start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address; and

device-specific control data for the second device.

45. A storage medium that stores machine instructions comprising a computer program which, when executed by a processor-based video data encoder, causes the video data encoder to perform the steps of:

receiving a video signal defining a plurality of frames, each frame comprising a plurality of lines, the video signal defining programming information;

concatenating encoded data with a plurality of the lines of a plurality of the frames of the video signal to create an encoded video signal;

the encoded data defining both a signal detection word comprising a plurality of bits and at least one content word comprising a plurality of bits in association with each frame such that at least one of the signal detection word and the at least one content word further comprises a plurality of error correction bits defining a correction sequence that allows a single-bit error in the plurality of data bits to be detected and corrected; and

wherein content words define;

a first address associated with a first device;

device-specific control data for the first device;

a second address associated with a second device; and

device-specific control data for the second device.

46. A method for encoding control data in a video signal defining a plurality of frames, each frame comprising a plurality of lines, comprising the steps of:

concatenating encoded data with the lines of the video signal to create an encoded video signal;

configuring the encoded data to define signal detection data and content data in association with each frame, such that a consecutive series of signal detection words defines a dynamic validation sequence in which each signal detection word varies in at least two bits from an immediately preceding signal detection word; and

the content data defining;

a first address associated with a first device;

device-specific control data for the first device;

a second address associated with a second device; and

device-specific control data for the second device.

47. A storage medium for storing machine instructions comprising a computer program which, when executed by a processor-based video data encoder, causes the video data encoder to perform the steps of:

receiving a video signal defining a plurality of frames, each frame comprising a plurality of lines, the video signal defining programming information;

concatenating encoded data with a plurality of the lines of a plurality of the frames of the video signal to create an encoded video signal;

the encoded data defining both signal detection data and content data in association with each frame, such that a consecutive series of signal detection words defines a dynamic validation sequence in which each signal detection word varies in at least two bits from the immediately preceding signal detection word; and

the content data defining;

a first address associated with a first device;

device-specific control data for the first device;

a second address associated with a second device; and

device-specific control data for the second device.

48. A method for encoding control data in a video signal defining a plurality of frames, each frame comprising a plurality of lines, comprising the steps of:

providing a video signal, the video signal defining a plurality of frames, each frame comprising a plurality of lines, at least part of the video signal corresponding to a visible raster portion of the video signal comprising data used to generate a picture on a display;

concatenating encoded data with the lines of the video signal to create an encoded video signal, such that the encoded data are not concatenated with portions of the video signal corresponding to a vertical blanking interval;

configuring the encoded data to define both signal detection data and content data in association with each frame, and

the content data defining;

a first start-packet short address word associated with a first device, the first start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address;

device-specific control data for the first device;

a second start-packet short address word associated with a second device, the second start-packet short address word comprising a plurality of bits, including at least one bit identifying the word as an address word, and a plurality of bits identifying the word as a start packet of a long address; and

device-specific control data for the second device.

49. A method for encoding control data in a video signal defining a plurality of frames, each frame comprising a plurality of lines, comprising the steps of:

concatenating encoded data with the lines of the video signal to create an encoded video signal, such that the encoded data are included within the plurality of frames that define the video signal, and are not concatenated with either of;

portions of the video signal corresponding to a vertical blanking interval; and

portions of the video signal corresponding to a visible raster; and

configuring the encoded data to define signal detection data comprising a plurality of data bits and content data in association with each frame, the content data defining;

a first address associated with a first device, the first address comprising a first start-packet short address word;

device-specific control data for the first device;

a second address associated with a second device, the second address comprising a second start-packet short address word; and

device-specific control data for the second device; and

interpreting the second start-packet short address as a first end-packet short address word for the first device.

50. A method for encoding control data in a video signal defining a plurality of frames, each frame comprising a plurality of lines, comprising the steps of:

concatenating encoded data with the lines of the video signal to create an encoded video signal, such that the encoded data are included within the plurality of frames that define the video signal and are not concatenated with either of;

portions of the video signal corresponding to a vertical blanking interval; and

portions of the video signal corresponding to a visible raster; and

configuring the encoded data to define signal detection data comprising a plurality of data bits and content data in association with each frame, the content data defining;

a first address associated with a first device, the first address comprising a start-packet begin-long-address word;

a first occurrence of a long address word associated with the first device;

a start-packet end-long-address word associated with the first device;

device-specific control data for the first device;

a second address associated with a second device; and

device-specific control data for the second device.

51. A method for encoding control data in a video signal defining a plurality of frames, each frame comprising a plurality of lines, comprising the steps of:

concatenating encoded data with the lines of the video signal to create an encoded video signal, such that the encoded data are included within the plurality of frames that define the video signal and are not concatenated with either of;

portions of the video signal corresponding to a vertical blanking interval; and

portions of the video signal corresponding to a visible raster; and

configuring the encoded data to define;

signal detection data comprising at least one signal detection word, each signal detection word comprising a plurality of data bits and a plurality of error correction bits defining a correction sequence that enable a single-bit error in the data bits to be detected and corrected; and

content data in association with each frame, the content data defining;

a first address associated with a first device;

device-specific control data for the first device;

a second address associated with a second device; and

device-specific control data for the second device.