Object information derived from object images

• US 8,478,047 B2
• Filed: 04/09/2012
• Issued: 07/02/2013
• Est. Priority Date: 11/06/2000
• Status: Expired due to Term

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Boncyk, Wayne C., Cohen, Ronald H.
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US13/442,660
• Publication Number:
  US 20120195468A1
• Time in Patent Office: 449 Days
• Field of Search: 382162-165, 382/181, 382/100, 382/224, 382/305, 382115-118, 348/239, 3482112-2116, 348/207.1, 348/460, 348/552, 705 261- 272, 705/23, 713/186, 713/168, 455/414.3, 455/411, 455/414.2, 455/412.1, 455/456.5, 455/456.6
• US Class Current: 382/181
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0641 Shopping interfaces

Abstract

Search terms are derived automatically from images captured by a camera equipped cell phone, PDA, or other image capturing device, submitted to a search engine to obtain information of interest, and at least a portion of the resulting information is transmitted back locally to, or nearby, the device that captured the image.

Claims

1. An information retrieval system comprising:

a device connection configured to couple with a device and obtain a digital representation related to an object from the device; and

a content identification platform configured to;

obtain the digital representation via the device connection;

recognize the object as a target object from the digital representation;

derive a query strategy targeting at least one search engine based on at least one object attribute determined from the target object;

obtain a result set from the at least one search engine in response to submission of a query according to the query strategy;

process the result set to form a tailored result set for the device; and

cause the tailored result set to be transmitted to the device.

2. The system of claim 1, wherein the tailored result set is a sub-set of the result set.

3. The system of claim 1, wherein the tailored result set is processed to accommodate the device.

4. The system of claim 1, wherein the tailored result set depends on additional information related to the device.

5. The system of claim 4, wherein the additional information comprises a location.

6. The system of claim 4, wherein the additional information comprises an identity of a user of the device.

7. The system of claim 4, wherein the additional information comprises a time.

8. The system of claim 1, wherein the at least one object attribute comprises at least two dimensions of relevance.

9. The system of claim 8, wherein the at least one object attribute comprises at least three dimensions of relevance.

10. The system of claim 9, wherein the at least one object attribute comprises at least four dimensions of relevance.

11. The system of claim 1, wherein the at least one object attribute comprises at least one of the following:

a name, a type, a size, a shape, a location, a position, an orientation, and a model.

12. The system of claim 1, wherein the at least one object attribute are derived at least in part from markings on the object.

13. The system of claim 1, wherein the at least one object attribute changes with time.

14. The system of claim 13, wherein the at least one object attribute includes at least one of the following:

a speed, a movement pattern, a gesture, and an acceleration.

15. The system of claim 1, wherein the tailored result set comprises interactive content.

16. The system of claim 15, wherein the interactive content enables the device to initiate a transaction with a selected account.

17. The system of claim 15, wherein the interactive content comprises a request for additional information from the device.

18. The system of claim 1, wherein the tailored result set comprises at least one of the following types of data:

streamed data, audio data, video data, graphic data, a phone number, a uniform resource locator, a network address, a frequency, and a channel.

19. The system of claim 1, wherein the content identification platform resides within the device.

20. The system of claim 1, wherein the digital representation related to the object comprises imagery data related to the object.

21. The system of claim 1, wherein the digital representation related to the object comprises non-visual data related to the object.

22. The system of claim 21, wherein the non-visual data comprises sound data.

23. The system of claim 1, wherein the target object corresponds to printed media.

24. The system of claim 23, wherein the target object corresponds to at least a portion of one of the following:

a poster, a sign, a beverage can, a video box, a music box, a magazine, a news paper, a passport, a driver'"'"'s license, a billboard, and a product packaging.

25. The system of claim 1, wherein the device connection is configured to couple with a mobile phone operating as the device.