Data capture and identification system and process

• US 10,095,712 B2
• Filed: 11/20/2017
• Issued: 10/09/2018
• Est. Priority Date: 11/06/2000
• Status: Expired due to Fees

• Current Assignee: Evyrx Technologies, Inc., Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Boncyk, Wayne C., Cohen, Ronald H.
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US15/818,312
• Publication Number:
  US 20180081907A1
• Time in Patent Office: 323 Days
• Field of Search: 382305, 382100
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/7515 Shifting the patterns to accommodate for positional errors
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04M 1/0202 Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets constructional features of telephone transmitters or receivers, e.g. of speakers or microphones H04M1/03

Abstract

An identification method and process for objects from digitally captured images thereof that uses data characteristics to identify an object from a plurality of objects in a database. The data is broken down into parameters such as a Shape Comparison, Grayscale Comparison, Wavelet Comparison, and Color Cube Comparison with object data in one or more databases to identify the actual object of a digital image.

Claims

1. A mobile device image search system, comprising an image processing platform coupled with a memory and programmed to:

store, in a database, a plurality of reference images including a plurality of reference image characteristics corresponding to a target object including at least one reference shape characteristic of the target object and associated with an information address linking to an item of content information;

obtain, from a mobile device sensor of a mobile device, an image associated with the image, the image including a depiction of an object;

receive ancillary information corresponding to the object;

segment the image into a plurality of image segments;

determine at least one image shape characteristic from at least one image segment from the plurality of image segments;

recognize the object in image as the target object in the at least one image segment based at least in part on a search of the database using the at least one image shape characteristic;

associate, in the database, the ancillary information with the target object in the plurality of reference images;

in response to at least one of (a) identifying the target object in a subsequently-received second image segment corresponding to a received second image or (b) a query using the ancillary information;

obtain the information address associated with the target object based on the ancillary information; and

present the item of content information on a display of the mobile device based on the information address.

2. The system of claim 1, wherein the target object comprises a person.

3. The system of claim 1, wherein the first ancillary information comprises information associated with at least one of the mobile device, an organization, and a user.

4. The system of claim 1, wherein identifying the target object in a subsequently-received image segment corresponding to a received second image further comprises:

segment the second image into a second plurality of image segments including the second image segment;

determine at least one second image shape characteristic from the second image segment; and

recognize the object in second image as the target object in the second image segment based at least in part on a search of the database using the at least one second image shape characteristic.

5. The system of claim 1, wherein the mobile device comprises at least one of a computer, a mobile telephone and a personal digital assistant.

6. The system of claim 1, wherein the image processing platform is further programmed to enable an interaction with the item of content information based on the information address.

7. The system of claim 6, wherein the interaction comprises a transaction.

8. The system of claim 6, wherein the interaction comprises a purchase.

9. The system of claim 8, wherein a payment is billed to an account associated with a user of the mobile device.

10. The system of claim 1, wherein the information address comprises at least one of the following:

a network address, an information address, and a URL.

11. A method, comprising:

storing, in a database, a plurality of reference images including a plurality of reference image characteristics corresponding to a target object including at least one reference shape characteristic of the target object and associated with an information address linking to an item of content information;

obtaining, from a mobile device sensor of a mobile device, an image associated with the image, the image including a depiction of an object;

receiving ancillary information corresponding to the object;

segmenting the image into a plurality of image segments;

determining at least one image shape characteristic from at least one image segment from the plurality of image segments;

recognizing the object in image as the target object in the at least one image segment based at least in part on a search of the database using the at least one image shape characteristic;

associating, in the database, the ancillary information with the target object in the plurality of reference images;

in response to at least one of (a) identifying the target object in a subsequently-received second image segment corresponding to a received second image or (b) receiving a query using the ancillary information;

obtaining the information address associated with the target object based on the ancillary information; and

presenting the item of content information on a display of the mobile device based on the information address.

12. The method of claim 11, wherein the target object comprises a person.

13. The method of claim 11, wherein the first ancillary information comprises information associated with at least one of the mobile device, an organization, and a user.

14. The method of claim 11, wherein identifying the target object in a subsequently-received image segment corresponding to a received second image further comprises:

segmenting the second image into a second plurality of image segments including the second image segment;

determining at least one second image shape characteristic from the second image segment; and

recognizing the object in second image as the target object in the second image segment based at least in part on a search of the database using the at least one second image shape characteristic.

15. The method of claim 11, wherein the mobile device comprises at least one of a computer, a mobile telephone and a personal digital assistant.

16. The method of claim 11, wherein the image processing platform is further programmed to enable an interaction with the item of content information based on the information address.

17. The method of claim 16, wherein the interaction comprises a transaction.

18. The method of claim 16, wherein the interaction comprises a purchase.

19. The method of claim 18, wherein a payment is billed to an account associated with a user of the mobile device.

20. The method of claim 11, wherein the information address comprises at least one of the following:

a network address, an information address, and a URL.