Data capture and identification system and process

• US 9,824,099 B2
• Filed: 12/28/2016
• Issued: 11/21/2017
• Est. Priority Date: 11/06/2000
• Status: Expired due to Term

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Boncyk, Wayne C., Cohen, Ronald H.
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US15/392,935
• Publication Number:
  US 20170124119A1
• Time in Patent Office: 328 Days
• Field of Search: 382100, 382305, 705 261- 272
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/7515 Shifting the patterns to accommodate for positional errors
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04M 1/0202 Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets constructional features of telephone transmitters or receivers, e.g. of speakers or microphones H04M1/03

Abstract

An identification method and process for objects from digitally captured images thereof that uses data characteristics to identify an object from a plurality of objects in a database. The data is broken down into parameters such as a Shape Comparison, Grayscale Comparison, Wavelet Comparison, and Color Cube Comparison with object data in one or more databases to identify the actual object of a digital image.

Claims

1. A mobile device image search system, comprising an image processing platform coupled with a memory and programmed to:

store, in a database, a plurality of reference image characteristics corresponding to a target object and associated with an information address linking to an item of content information;

store, in the database, a first ancillary information associated with at least one of (a) the plurality of reference image characteristics, (b) the target object and (c) the information address;

obtain, from a mobile device sensor of a mobile device, an image and an image ancillary information associated with the image;

determine a first plurality of image characteristics from the image;

recognize the image as associated with the target object based at least in part on a search of the database using the first plurality of image characteristics against the plurality of reference image characteristics and the image ancillary information against the first ancillary information;

obtain the information address associated with the target object; and

present the item of content information on a display of the mobile device based on the information address.

2. The system of claim 1, wherein the first ancillary information comprises information associated with at least one of the mobile device, an organization, and a user.

3. The system of claim 1, wherein the plurality of image characteristics are associated with a plurality of reference images, and the image processing platform is further programmed to:

recognize the image by selecting a subset of the plurality of reference images as a function of the image ancillary information and first ancillary information; and

search the database by using the first and second image characteristics against the image characteristics of the subset of the plurality of reference images.

4. The system of claim 1, wherein the image processing platform is further programmed to:

store, in the database, a second ancillary information associated with (a) at least one of the plurality of image characteristics and the target object and (b) a second information address linking to a second item of content information;

receive, from a second mobile sensor of a second mobile device, a second image and a second image ancillary information associated with the second image;

determine a second plurality of image characteristics from the second image;

recognize the second image as associated with the target object based at least in part on a search of the database using the second plurality of image characteristics from the second image against the plurality of reference image characteristics;

obtain the second information address as a function of the second image ancillary information and the second ancillary information; and

present the second item of content information on a display of the second mobile device based on the second information address.

5. The system of claim 1, wherein the mobile device comprises at least one of a computer, a mobile telephone and a personal digital assistant.

6. The system of claim 1, wherein the information address is stored in the database, and further comprising a second database storing the item of content information, wherein the second database separate from the database.

7. The system of claim 1, wherein the image processing platform is further programmed to enable an interaction with the item of content information based on the information address.

8. The system of claim 7, wherein the interaction comprises a transaction.

9. The system of claim 7, wherein the interaction comprises a purchase.

10. The system of claim 9, wherein a payment is billed to an account associated with a user of the mobile device.

11. The system of claim 1, wherein the information address comprises at least one of the following:

a network address, an information address, and a URL.

12. A method of providing digital content to a user, comprising:

storing, in a database, a plurality of reference image characteristics corresponding to a target object and associated with an information address linking to an item of content information;

storing, in the database, a first ancillary information associated with at least one of (a) the plurality of reference image characteristics, (b) the target object and (c) the information address;

obtaining, by an image processing platform and from a mobile device sensor of a mobile device, an image and an image ancillary information associated with the image;

determining, by the image processing platform, a first plurality of image characteristics from the image;

recognizing, by the image processing platform, the image as associated with the target object based at least in part on a search of the database using the first plurality of image characteristics against the plurality of reference image characteristics and the image ancillary information against the first ancillary information;

obtaining, by the image processing platform, the information address associated with the target object; and

causing a display of the mobile device to present the item of content information based on the information address.

13. The method of claim 12, wherein the first ancillary information comprises information associated with at least one of the mobile device, an organization, and a user.

14. The method of claim 12, wherein the plurality of image characteristics are associated with a plurality of reference images, the method further comprising:

recognizing, by the image processing platform, the image by selecting a subset of the plurality of reference images as a function of the image ancillary information and first ancillary information; and

searching, by the image processing platform, the database by using the first and second image characteristics against the image characteristics of the subset of the plurality of reference images.

15. The method of claim 12, further comprising:

storing, in the database, a second ancillary information associated with (a) at least one of the plurality of image characteristics and the target object and (b) a second information address linking to a second item of content information;

receiving, from a second mobile sensor of a second mobile device, a second image and a second image ancillary information associated with the second image;

determining, by the image processing platform, a second plurality of image characteristics from the second image;

recognizing, by the image processing platform, the second image as associated with the target object based at least in part on a search of the database using the second plurality of image characteristics from the second image against the plurality of reference image characteristics;

obtaining, by the image processing platform, the second information address as a function of the second image ancillary information and the second ancillary information; and

presenting, by the image processing platform, the second item of content information on a display of the second mobile device based on the second information address.

16. The method of claim 12, wherein the mobile device comprises at least one of a computer, a mobile telephone and a personal digital assistant.

17. The method of claim 12, wherein the information address is stored in the database, the method further comprising storing, in a second database, the item of content information, wherein the second database separate from the database.

18. The method of claim 12, further comprising enabling, by the image processing platform, an interaction with the item of content information based on the information address.

19. The method of claim 18, wherein the interaction comprises a transaction.

20. The method of claim 18, wherein the interaction comprises a purchase.

21. The method of claim 20, further comprising billing a payment to an account associated with a user of the mobile device.

22. The method of claim 12, wherein the information address comprises at least one of the following:

a network address, an information address, and a URL.