Remote control signaling using audio watermarks

• US 8,106,745 B2
• Filed: 12/01/2010
• Issued: 01/31/2012
• Est. Priority Date: 02/16/2000
• Status: Expired due to Fees

• Current Assignee: Verance Corporation
• Original Assignee: Verance Corporation
• Inventors: Petrovic, Rade, Winograd, Joseph M.
• Primary Examiner(s): Nguyen, Nam V
• Application Number:
  US12/958,292
• Publication Number:
  US 20110068898A1
• Time in Patent Office: 426 Days
• Field of Search: 340/5.28, 340/5.42, 340/12.5, 340/13.24, 380/54, 380/201, 380/203, 380/44, 726/4, 726/28, 382/100, 382/237, 382/250, 382/232, 713/176, 713/178, 713/179, 283/72, 399/366
• US Class Current: 340/5.28
• CPC Class Codes: G06F 7/00 Methods or arrangements for processing data by operating upon the order or content of the data handled logic circuits H03K19/00
• CPC Class Codes: G06Q 30/0264 based upon schedule
• CPC Class Codes: G08C 23/02 using infrasonic, sonic or ultrasonic waves
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04B 11/00 Transmission systems employing sonic, ultrasonic or infrasonic waves

Abstract

A system for using a watermark embedded in an audio signal to remotely control a device. Various devices such as toys, computers, and appliances, equipped with an appropriate detector, detect the hidden signals, which can trigger an action, or change a state of the device. The watermarks can be used with a “time gate” device, where detection of the watermark opens a time interval within which a user is allowed to perform an action, such as pressing a button, typing in an answer, turning a key in a lock, etc.

Claims

1. A method, comprising:

receiving, at a user device, an audio content embedded with one or more substantially inaudible watermarks, the audio content having been acoustically propagated to the user device, wherein the one or more substantially inaudible watermarks include designed characteristics that improve watermark robustness against impairments due to acoustic propagation of the audio content;

recovering at least one embedded watermark from a first portion of the received audio content; and

in response to the recovery of the at least one embedded watermark, enabling an operation of the user device in synchronization with subsequent portions of the audio content.

2. The method of claim 1, wherein the one or more substantially inaudible watermarks comprise control data for controlling the user device.

3. The method of claim 1, wherein the operation comprises controlling an electronic interface associated with the user device.

4. The method of claim 1, wherein the operation comprises:

presenting an interactive opportunity to a user of the user device; and

receiving one or more inputs from the user in response to the presentation of the interactive opportunity.

5. The method of claim 4, wherein the one or more inputs is received pursuant to a user action selected from the group of user actions consisting of:

providing an answer to a quiz;

pressing a button; and

typing a text.

6. The method of claim 4, further comprising processing the one or more inputs to obtain a particular result.

7. The method of claim 4, further comprising storing the one or more inputs.

8. The method of claim 4, wherein a sales transaction is facilitated in accordance with the one or more user inputs.

9. The method of claim 1, wherein the operation comprises displaying information on a display screen.

10. The method of claim 9, wherein:

the display screen is located remotely from the user device; and

the user device transmits the information to the display screen.

11. The method of claim 1, wherein the operation comprises playing an audio content.

12. The method of claim 1, wherein the operation comprises commencing a mechanical movement.

13. The method of claim 1, wherein the operation comprises changing a state of the user device.

14. The method of claim 1, wherein the user device is selected from a group of devices consisting of:

a computer;

a handheld device;

a toy;

an appliance; and

a smart card.

15. The method of claim 1, wherein the audio content is part of a multimedia content and the operation is carried out in synchronization with a video portion of the multimedia content.

16. The method of claim 1, wherein

the operation comprises generating an electronic coupon;

and

the electronic coupon is collected by a user of the user device during a particular time interval.

17. The method of claim 1, wherein the operation comprises polling a viewer of an audio-visual program.

18. The method of claim 17, wherein

the polling is conducted in association with an advertised product;

the viewer'"'"'s responses to the poll are collected by the user device; and

the collected responses are used to facilitate a sales transaction.

19. The method of claim 1, wherein

the audio content is part of an educational audio-visual program;

and

the operation comprises requesting a viewer of the educational audio-visual program to enter a response.

20. The method of claim 19, wherein alertness of the viewer is monitored by determining whether or not the response was entered within a particular time interval.

21. The method of claim 1, wherein the designed characteristics improve watermark robustness against intersymbol interference due to multipath propagation of the audio content.

22. The method of claim 1, wherein the designed characteristics comprise distinct signaling channels associated with adjacent bits of the one or more substantially inaudible watermarks.

23. The method of claim 1, wherein at least one of the substantially inaudible watermarks is embedded in the audio content at least in part by:

evaluating masking ability of the audio content;

embedding the at least one substantially inaudible watermark in the audio content based on the masking ability, the at least one substantially inaudible watermark comprising information indicative of a delay associated with enabling the operation of the user device.

24. The method of claim 1, wherein the audio content is embedded with multiple substantially inaudible watermarks and wherein recovery of any one of the multiple substantially inaudible watermarks can enable the operation of the user device.

25. A method, comprising:

receiving, at a device, an acoustically propagated audio content embedded with one or more substantially inaudible watermarks, wherein the one or more substantially inaudible watermarks include designed characteristics that improve watermark robustness against impairments due to acoustic propagation of the audio content;

recovering at least one embedded watermark from the received audio content;

obtaining a control message from the recovered watermark(s); and

controlling an operation of the device in accordance with the control message and in concert with the acoustically propagated audio content.

26. The method of claim 25, wherein

the device is an electronic lock;

and

the operation comprises enabling an opening or a closure of the electronic lock for a duration of a time interval in accordance with the one or more substantially inaudible watermarks.

27. The method of claim 26, wherein the electronic lock is opened or closed remotely.

28. The method of claim 26, wherein the electronic lock is opened or closed using a key.

29. The method of claim 25, wherein the acoustically propagated audio content is originated from a telephone.

30. The method of claim 25, wherein the acoustically propagated audio content is originated from a public address announcement system.

31. A device, comprising:

a receiver configured to receive an audio content embedded with one or more substantially inaudible watermarks, the audio content having been acoustically propagated to the receiver, wherein the one or more substantially inaudible watermarks include designed characteristics that improve watermark robustness against impairments due to acoustic propagation of the audio content;

an extractor configured to recover at least one embedded watermark from a first portion of the received audio content;

a control module configured to, in response to the recovery of the at least one embedded watermark, enable an operation of the user device in synchronization with subsequent portions of the audio content.

32. The device of claim 31, wherein the one or more substantially inaudible watermarks comprise control data for controlling the user device.

33. The device of claim 31, wherein the operation comprises controlling an electronic interface associated with the user device.

34. The device of claim 31, wherein the operation comprises:

presenting an interactive opportunity to a user of the user device; and

receiving one or more inputs from the user in response to the presentation of the interactive opportunity.

35. The device of claim 34, wherein the one or more inputs is received pursuant to a user action selected from the group of user actions consisting of:

providing an answer to a quiz;

pressing a button; and

typing a text.

36. The device of claim 34, further configured to process the one or more inputs to obtain a particular result.

37. The device of claim 34, further configured to store the one or more inputs.

38. The device of claim 34, further configured to facilitate a sales transaction in accordance with the one or more user inputs.

39. The device of claim 31, wherein the operation comprises displaying information on a display screen.

40. The device of claim 39, wherein:

the display screen is located remotely from the user device; and

the user device is configured to transmit the information to the display screen.

41. The device of claim 31, wherein the operation comprises playing an audio content.

42. The device of claim 31, wherein the operation comprises commencing a mechanical movement.

43. The device of claim 31, wherein the operation comprises changing a state of the user device.

44. The device of claim 31, wherein the user device is selected from a group of devices consisting of:

a computer;

a handheld device;

a toy;

an appliance; and

a smart card.

45. The device of claim 31, wherein the audio content is part of a multimedia content and the operation is carried out in synchronization with a video portion of the multimedia content.

46. The device of claim 31, wherein

the operation comprises generating an electronic coupon;

and

the electronic coupon is collected by a user of the user device during a particular time interval.

47. The device of claim 31, wherein the operation comprises polling a viewer of an audio-visual program.

48. The device of claim 47, wherein

the polling is conducted in association with an advertised product;

the user device is configured to collect the viewer'"'"'s responses to the poll; and

the collected responses are used to facilitate a sales transaction.

49. The device of claim 31, wherein

the audio content is part of an educational audio-visual program;

and

the operation comprises requesting a viewer of the educational audio-visual program to enter a response.

50. The device of claim 49, wherein alertness of the viewer is monitored by determining whether or not the response was entered within a particular time interval.

51. A non-transitory computer-readable medium with an audio content embodied thereupon, the audio content comprising:

one or more substantially inaudible watermarks that are embedded in the audio content, wherein the one or more substantially inaudible watermarks include designed characteristics that improve watermark robustness against impairments due to acoustic propagation of the audio content and wherein upon the reception of the audio content that has been acoustically propagated to a user device equipped with a watermark extractor, the user device is triggered to;

recover at least one embedded watermark from a first portion of the received audio content; and

in response to the recovery of the at least one embedded watermark, enable an operation of the user device in synchronization with subsequent portions of the audio content.