Methods and devices for detecting linkable objects

• US 7,775,437 B2
• Filed: 06/01/2006
• Issued: 08/17/2010
• Est. Priority Date: 06/01/2006
• Status: Active Grant

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Evryx Technologies Inc (Ipplex Holdings Corporation)
• Inventors: Cohen, Ronald H.
• Primary Examiner(s): TRAIL, ALLYSON NEEL
• Application Number:
  US11/445,784
• Publication Number:
  US 20070279521A1
• Time in Patent Office: 1,538 Days
• Field of Search: 235/462.45, 235/462.3, 235/461.1, 235/462.07, 235/462.11, 235/462.21, 235/472.02, 235/375
• US Class Current: 235/462.45
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00326 with a data reading, recognizing or recording apparatus, e.g. with a bar-code apparatus arrangements for the associated working of recording or reproducing apparatus with related apparatus G11B31/00
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A camera portion of a portable consumer device obtains data from a field of view, and at least a portion of the data is used to determine existence of an object in the field of view for which the information is available from a reference source. An indication is then provided to the user that the object is in the field of view. This can all be accomplished by a functionality, such as computer software, that executes on one or both of the device and a distal server. Objects within the field that the system can identify and provide information are deemed “linkable.” Once a user is presented with an indication of which objects around him are linkable, he can then directly point and click on the linkable objects without the “trial-and-error” process of pointing and clicking on non-linkable objects.

Claims

1. A method of helping a user utilize a portable consumer device to obtain information, the method comprising providing a functionality that:

obtains data from a field of view captured by a camera portion of the device;

uses at least a portion of the data to determine existence of at least one object in the field of view;

identifies the at least one object as a linkable object for which information is made available from a reference source; and

provides an indication to the user that the at least one object is in the field of view, and is a linkable object having information available from the reference source upon user selection of the at least one object by displaying a mark superimposed on a displayed image of the field of view where the mark indicates a location of the linkable object with respect to the field of view.

2. The system of claim 1, wherein the functionality includes image processing software that runs on a processor in the device.

3. The system of claim 2, wherein the step of providing the functionality comprises at least one of marketing and selling a telephony device that includes the software.

4. The system of claim 2, wherein the step of providing the functionality comprises at least one of providing the software for loading onto the device.

5. The system of claim 1, wherein the functionality includes an image matching service that runs on a processor in a server distal to the device.

6. The system of claim 1, wherein the data comprises image data.

7. The system of claim 1, wherein the device comprises a mobile telephone.

8. The system of claim 1, wherein the device is selected from the group consisting of a hand-held computer and a personal digital assistant (PDA).

9. The system of claim 1, further comprising displaying the information on a display of the device.

10. The system of claim 1, wherein the data is a single image of the field of view.

11. The system of claim 1, wherein the data includes a plurality of images that arise from moving the device.

12. The system of claim 1, wherein the data includes a plurality of images that depict movement of the object.

13. The system of claim 1, wherein the data includes a plurality of images that depict entry of a second, different object into the field of view, for which second information is available from the reference source.

14. The system of claim 1, wherein the indication comprises a graphic displayed on a display of the device.

15. The system of claim 1, wherein the indication comprises text displayed on a display of the device.

16. The system of claim 1, wherein the indication comprises at least one of a graphic and text superimposed on the object on a display of the device.

17. The system of claim 1, wherein the indication comprises outlining at least a portion of the object on a display of the device.

18. The system of claim 1, wherein the indication comprises a sound.

19. The system of claim 1, wherein the indication comprises tactile feedback to the user.

20. The system of claim 1, wherein the indication comprises transmission of an electromagnetic signal.

21. The system of claim 20, wherein the electromagnetic signal is selected from the list consisting of an email and a text message.

22. The system of claim 1, wherein the indication comprises activation of a software process.

23. The system of claim 1, wherein the functionality is capable of identifying the object as human being.

24. The system of claim 1, wherein the functionality is capable of identifying the object as a barcode.

25. The system of claim 1, wherein the functionality is capable of identifying the object as a symbol other than a barcode.