Wireless Mobile Phone Methods

• US 20080014917A1
• Filed: 05/31/2007
• Published: 01/17/2008
• Est. Priority Date: 06/29/1999
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rhoads, Geoffrey, Rodriguez, Tony
• Granted Patent: US 7,760,905 B2
• Time in Patent Office: Days
• US Class Current: 455/422.1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04W 24/00 Supervisory, monitoring or testing arrangements
• CPC Class Codes: H04W 88/02 Terminal devices
• CPC Class Codes: H04W 99/00 Subject matter not provided for in other groups of this subclass

Abstract

A user gestures with a wireless mobile phone device to control some aspect of its operation, or the operation of a remote system with which the device communicates. (The gestures may be sensed by tracking movement of a feature across a field of view of a mobile phone device camera.) The resultant operation may additionally depend on other data obtained by the wireless device, e.g., obtained from an electronic or physical object, or sensed from the environment. A variety of other features and arrangements are also detailed.

Claims

1. A method of operating a wireless mobile phone device comprising the acts:

a user moving the wireless mobile phone device to make a gesture;

obtaining data either from an environment of said device, or relating to an object; and

at a computer device, performing an action in accordance with said gesture and said obtained data.

2. The method of claim 1 that includes obtaining data from an electronic object, by processing object data to yield an identifier.

3. The method of claim 2 in which said processing object data comprises applying a watermark decoding operation to said object data.

4. The method of claim 1 that includes obtaining data by using a sensor.

5. The method of claim 4 that includes sensing machine readable data using said sensor.

6. The method of claim 1 that includes obtaining data by using an optical sensor.

7. The method of claim 1 in which said computer device comprises the wireless mobile phone device.

8. The method of claim 1 in which said computer device comprises a device distinct from the wireless mobile phone device.

9. The method of claim 1 wherein the gesture comprises moving the wireless mobile phone device in a sideways motion—

translating its position within a plane;

10. The method of claim 1 in which said action relates to sending a message from said wireless mobile phone device.

11. The method of claim 1 in which said action relates to invoking a teleconference.

12. The method of claim 1 in which said action relates to calendaring an appointment.

13. The method of claim 1 in which said action relates to viewing a video.

14. The method of claim 1 that further includes sending information related to said gesture and said obtained data from the wireless mobile phone device to a remote system.

15. The method of claim 14 wherein said remote system comprises said computer device.

16. The method of claim 14 that further includes receiving data at the wireless mobile phone device, said data being sent to the device as a consequence of the action taken by the remote system.

17. The method of claim 1 that further includes generating data relating to said gesture.

18. The method of claim 17 in which the wireless mobile phone device includes a 2D optical sensor, and said generating includes tracking movement of a feature across a field of view of said sensor, and inferring movement therefrom.

19. A method comprising the acts:

using a wireless mobile phone device to produce image data corresponding to an object;

transmitting the image data to a remote computer device; and

at the remote computer device, taking an action, wherein the taken action depends on an orientation of an object represented by said image data.

20. A method comprising the acts:

capturing plural frames of image information using a wireless mobile phone device;

transmitting image data related to said captured frames from the wireless mobile phone device to a remote computer device; and

at the remote computer device, taking an action, wherein the taken action depends on movement of a feature in said captured image frames.

21. In a device including a processor and a memory, the memory having registry data stored therein, the registry data associating certain data types with related information corresponding thereto, a method comprising the acts:

sensing image data using a 2D sensor associated with said device;

deriving an identifier from the image data;

consulting the registry for information corresponding to the identifier; and

taking an action based, at least in part, on said registry information.

22. A method comprising the acts:

encoding an advertisement with first auxiliary information, and distributing same in a first manner;

encoding the same advertisement with second auxiliary information different than the first, and distributing same in a second manner different than the first; and

through use of the auxiliary information encoded therein, determining which manner of distribution for said advertisement is more effective.

23. A device including a module for deriving an identifier from audio or visual content, operable to transmit a packet of data to a remote system, said packet of data comprising (a) an identifier of said module, and (b) at least a portion of said identifier.

24. The apparatus of claim 23, wherein said packet of data also includes address information identifying the device.

25. The apparatus of claim 23, wherein said module comprises software, and the packet of data comprises an identifier of said software.

26. A system comprising the device of claim 23 together with said remote system, the remote system including a router and plural handlers, the router directing data from said packet to one of said handlers depending on data within said packet.

27. A device including a module for deriving an identifier from audio or visual content, operable to transmit a packet of data to a remote system, said packet of data comprising (a) a context or environment identifier, and (b) at least a portion of said identifier.

28. A system comprising the device of claim 27 together with said remote system, the remote system including a router and plural handlers, the router directing data from said packet to one of said handlers depending on data within said packet.

29. A networked computer system, responsive to a content identifier that was derived from data representing audio or visual content processed on a remote device, to initiate delivery of advertisement data to said remote device.

30. The system of claim 29, wherein said content identifier was derived on said remote device.

31. A method for accessing a file on a computer system comprising:

presenting a printed version of said file to an optical sensor, the sensor yielding image data;

deriving an identifier from the image data, the identifier corresponding to said printed version;

by reference to said identifier, determining a file address associated with the file; and

accessing the file from said determined address.

32. A wireless communications device including an optical system comprising a 2D image sensor and an associated lens arrangement, characterized in that the lens arrangement has a first configuration in which subjects close to the wireless communications device can be focused on the image sensor, and a second configuration in which subjects further from the wireless communications device can be focused on the image sensor, the wireless communications device further including a wireless interface operable to transmit image-related data produced through use of said optical system.

33. The wireless communications device of claim 32 wherein said lens arrangement includes a first lens that is always included therein, and a second lens that can optionally be cascaded in said arrangement, the device being operable to transmit identification data derived from the image data.

34. The wireless communications device of claim 33 wherein a hinge or slide arrangement enables the second lens to optionally be cascaded in said arrangement.

35. In a device with an associated 2D image sensor system, a method of user interaction including the acts:

capturing plural frames of image data, the frames depicting one or more first subjects that are stationary, and a second subject that moves;

from image data corresponding to the second subject, deriving a plural-bit digital identifier; and

taking an action based on said derived identifier;

wherein movement of the second subject serves as a clue to the device that the second subject comprises a subject of interest.

36. In a device with an associated 2D image sensor system, a method of user interaction including the acts:

capturing image data using said 2D image sensor system;

examining the captured image data to discern an area bounded by four straight edges;

from image data corresponding to the discerned area, deriving a plural-bit digital identifier; and

taking an action based on said derived identifier;

wherein a boundary of four straight edges serves as a clue to the device that the area defined by said edges comprises a subject of interest.

37. In a device with an associated 2D image sensor system, a method of user interaction including the acts:

sensing image data;

deriving an identifier from the image data; and

by reference to said identifier, adapting a user interface of said device.

38. The method of claim 37 that includes determining whether the sensed image data corresponds to first or second talismans, and adapting the user interface in first or second respective manners.

39. The method of claim 37 that comprises employing one of plural lists of favorites web sites, in dependence on said derived identifier.

40. The method of claim 37 that includes employing one of plural desktop arrangements, in dependence on said derived identifier.

41. The method of claim 37 that includes tailoring a selection of application programs presented to a user, in dependence on said derived identifier.

42. A transaction method comprising the acts:

presenting a first credential to an optical sensor;

presenting a second credential to the same optical sensor; and

taking an action responsive to detection of certain data from said two credentials.

43. The method of claim 42 in which the optical sensor comprises a 2D sensor, and at least one of said credentials is steganographically encoded with plural-bit digital watermark data.

44. A method comprising the acts:

by reference to data sent from a user'"'"'s home, determining whether the user purchased admission to a theatrical performance of a motion picture; and

in response to an affirmative determination, extending to the user a privilege in connection with downloading a version of said motion picture.

45. The method of claim 44 wherein the privilege includes discounting a price for a pay-per-view version of said motion picture.

46. The method of claim 44 wherein the privilege relates to downloading a version of the motion picture for storage on writeable medium.

47. A credential authorizing a user to enter a performance venue, the credential having a seat corresponding thereto, characterized in that the credential conveys data permitting a user to inspect, on a screen of a display device, a view of the venue associated with said seat.

48. A document management method comprising:

presenting a paper sheet to an optical sensor, the sensor producing scan data comprising document image data, the paper sheet having an optically-detectable indicia thereon, the indicia being machine readable but not generally intelligible to a human viewer thereof;

processing the document image data to decode binary identification data represented by said indicia;

storing said document image data in a data store, wherein the document image data can thereafter be accessed from the data store by use of said binary identification data;

wherein a single scan of said paper sheet permits acquisition of both an image of the sheet for archiving, and identification data by which the stored image data can later be recalled.

49. A method comprising:

presenting an adhesive sticker to an optical sensor, the sensor producing scan data, the sticker having an optically-detectable, machine readable indicia thereon;

decoding the scan data to produce binary data corresponding to said indicia; and

displaying on a computer screen document data associated with said binary data.

50. A sheet of note-paper, the sheet having tacky adhesive on one side thereof, the sheet further having an optically-detectable indicia thereon, said indicia being machine-readable but not generally intelligible to a human viewer thereof.

51. A method employing image data captured by a 2D sensor in a handheld wireless communications device, the method comprising the acts:

at a system remote from said handheld wireless communications device, receiving data including said image data and device data, the device data enabling a response to be sent to said device;

at said remote system, deriving an identifier from said received image data; and

invoking an action based, at least in part, on the identifier derived from the image data by the remote system.

52. The method of claim 51, wherein the received data also includes GPS-based location data, and the invoked action depends on the derived identifier, the location data, and the device data.

53. A method responsive to audio or visual information, comprising the acts:

at a first computer at a first location, receiving data comprising data resulting from processing of audio or visual information by a handheld wireless communications device;

at said first computer determining, by reference to the received data, which of plural possible further computers should receive at least part of said data, and sending same to the determined further computer;

at said further computer, identifying information corresponding to the sent data; and

taking an action associated with said handheld wireless communications device, in accordance with the identified information.