Interactive systems and methods employing wireless mobile devices

• US 8,160,304 B2
• Filed: 05/19/2009
• Issued: 04/17/2012
• Est. Priority Date: 05/19/1999
• Status: Expired due to Fees

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rhoads, Geoffrey B., Rodriguez, Tony F.
• Primary Examiner(s): Johns, Andrew W
• Application Number:
  US12/468,703
• Publication Number:
  US 20090286572A1
• Time in Patent Office: 1,064 Days
• Field of Search: 382/100, 382/103, 715/863, 345/156, 455/3.03, 455/3.04, 455/3.06, 455/420, 348/552
• US Class Current: 382/107
• CPC Class Codes: G06F 16/9554 by using bar codes
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04W 24/00 Supervisory, monitoring or testing arrangements
• CPC Class Codes: H04W 88/02 Terminal devices
• CPC Class Codes: H04W 99/00 Subject matter not provided for in other groups of this subclass

Abstract

A user gestures with a wireless mobile phone device to control some aspect of its operation, or the operation of a remote system with which the device communicates. (The gestures may be sensed by tracking movement of a feature across a field of view of a mobile phone device camera.) The resultant operation may additionally depend on other data obtained by the wireless device, e.g., obtained from an electronic or physical object, or sensed from the environment. A variety of other features and arrangements are also detailed.

Claims

1. A method comprising:

generating data relating to movement of a mobile device by tracking movement of a feature across a field of view of a 2D optical sensor;

inferring movement of the mobile device based in part on the generated data;

obtaining data either from an environment of the mobile device, or relating to an object; and

providing the generated data and the obtained data to a computing device, wherein the computing device performs an action in accordance with the movement and the obtained data.

2. The method of claim 1, further comprising obtaining data from an electronic object, by processing object data to yield an identifier.

3. The method of claim 2, wherein processing object data comprises applying a watermark decoding operation to said object data.

4. The method of claim 1, further comprising obtaining data by using a sensor.

5. The method of claim 4, further comprising sensing machine readable data using the sensor.

6. The method of claim 1, further comprising obtaining data by using the 2D optical sensor.

7. The method of claim 1, wherein the computing device comprises the mobile device.

8. The method of claim 1, wherein the computing device comprises a device distinct from the mobile device.

9. The method of claim 1, further comprising translating a position of the mobile device within a plane, wherein the inferred movement comprises a sideways motion of the mobile device.

10. The method of claim 1, wherein the action relates to sending a message from the mobile device.

11. The method of claim 1, wherein the action relates to invoking a teleconference.

12. The method of claim 1, wherein the action relates to calendaring an appointment.

13. The method of claim 1, wherein the action relates to viewing a video.

14. The method of claim 1, further comprising sending the generated data and the obtained data from the mobile device to a remote system.

15. The method of claim 14, wherein the remote system comprises the computer device.

16. The method of claim 14, further comprising receiving data at the mobile device, wherein the data is sent to the device as a consequence of the action taken by the remote system.

17. A mobile device comprising:

a 2D optical sensor configured to;

generate visual data related to a field of view; and

obtain data either from an environment of the mobile device or relating to an object; and

a processor configured to;

infer movement of the mobile device by tracking movement of a feature in the visual data;

generate data relating to the movement; and

provide the generated data and the obtained data to a computing device, wherein the computing device performs an action in accordance with the generated data and the obtained data.

18. The mobile device of claim 17, wherein the computing device comprises the mobile device.

19. A non-transitory computer-readable medium having instructions, the instructions comprising:

instructions for generating data relating to movement of a mobile device by tracking movement of a feature across a field of view of a 2D optical sensor;

instructions for inferring movement of the mobile device based in part on the generated data;

instructions for obtaining data either from an environment of the mobile device, or relating to an object; and

instructions for providing the generated data and the obtained data to a computing device, wherein the computing device performs an action in accordance with the generated data and the obtained data.

20. The non-transitory computer-readable medium of claim 19, wherein the computing device comprises the mobile device.