Gestural use of wireless mobile phone devices to signal to remote systems

• US 7,536,034 B2
• Filed: 05/31/2007
• Issued: 05/19/2009
• Est. Priority Date: 05/19/1999
• Status: Expired due to Fees

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rhoads, Geoffrey B., Rodriguez, Tony F.
• Primary Examiner(s): Johns; Andrew W
• Application Number:
  US11/756,418
• Publication Number:
  US 20080019569A1
• Time in Patent Office: 719 Days
• Field of Search: 382/100, 382/103, 715/863, 345/156, 455/3.03, 455/3.04, 455/3.06, 455/420, 348/552
• US Class Current: 382/107
• CPC Class Codes: G06F 16/9554 by using bar codes
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04W 24/00 Supervisory, monitoring or testing arrangements
• CPC Class Codes: H04W 88/02 Terminal devices
• CPC Class Codes: H04W 99/00 Subject matter not provided for in other groups of this subclass

Abstract

A user gestures with a wireless mobile phone device to control some aspect of its operation, or the operation of a remote system with which the device communicates. (The gestures may be sensed by tracking movement of a feature across a field of view of a mobile phone device camera.) The resultant operation may additionally depend on other data obtained by the wireless device, e.g., obtained from an electronic or physical object, or sensed from the environment. A variety of other features and arrangements are also detailed.

Claims

1. A method of using a wireless mobile phone device to signal user intention to a remote system, the method including the acts:

a user moving the wireless mobile phone device from a first position to a second position, such movement effecting a user-controlled gesture; and

sending information related to the movement from the wireless mobile phone device to the remote system;

wherein the wireless mobile phone device includes a 2D optical sensor, and the method includes generating said information related to the movement by tracking movement of a feature across a field of view of said sensor, and inferring movement therefrom; and

wherein gesturing with the wireless mobile phone device offers an alternative to operating physical keys, in signaling user intention from said wireless mobile phone device to said remote system.

2. The method of claim 1 that includes receiving a request for information from the remote computer system before sending said information related to the movement.

3. The method of claim 1 that further includes, at the remote system, taking an action based at least in part on said sent information.

4. The method of claim 3 that further includes receiving data at the wireless mobile phone device, said data being sent to the device as a consequence of the action taken by the remote system.

5. The method of claim 4, wherein said data includes video data.

6. A method comprising:

establishing communication between a wireless mobile phone device and a remote computer device;

generating gesture-related data, said generating including monitoring motion of a feature within a field of view of a wireless mobile phone device image sensor;

sending the gesture-related data from the wireless mobile phone device to the remote computer device; and

receiving a response at the wireless mobile phone device, wherein the response depends—

at least in part—

on said sent gesture-related data.

7. The method of claim 6 that includes receiving a request for gesture-related data from the remote computer device, before sending said gesture-related data.

8. The method of claim 6 that includes obtaining data at the wireless mobile phone device, either from the environment, or from an object, and sending information corresponding to said obtained data from the wireless mobile phone device to the remote computer device, wherein said response also depends—

at least in part—

on said sent information.

9. A method comprising:

running a process on a first computer device;

receiving first data corresponding to a user gesture made with a remotely-located wireless mobile phone device, the gesture having been sensed by monitoring motion of a feature within a field of view of an image sensor that forms part of said device, and providing the first data as an input to the process running on the first computer device;

receiving second data from the remotely-located wireless mobile phone device, said second data comprising data obtained by said device from its environment, or from an object; and

taking an action based, at least in part, on said received first and second data.

10. The method of claim 9 in which said action includes sending information from the first computer device to the remotely-located wireless mobile phone device.

11. The method of claim 10 in which said sending includes sending video information.

12. A method of operating a wireless mobile phone device comprising the acts:

a user moving the wireless mobile phone device in a series of movements, a first movement comprising one selected from;

(a) a motion to the right or left;

(b) a rotational movement;

(c) a tilting movement;

or

(d) a forwards or backwards motion; and

the second movement also selected from the foregoing (a)-(d) but being different than the first movement;

sensing said movements by tracking movement of image data produced by a 2D optical sensor that forms part of said wireless mobile phone device; and

at a computer device, responding in accordance with said series of movements.

13. The method of claim 12 in which said computer device comprises the wireless mobile phone device.

14. The method of claim 12 wherein one of said movements comprises a rotational movement.