Data capture and identification system and process

• US 8,824,738 B2
• Filed: 08/16/2013
• Issued: 09/02/2014
• Est. Priority Date: 11/06/2000
• Status: Expired due to Fees

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Boncyk, Wayne C., Cohen, Ronald H.
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US13/968,666
• Publication Number:
  US 20130336530A1
• Time in Patent Office: 382 Days
• Field of Search: 382/305, 382/181, 382/103, 705 261- 272
• US Class Current: 382/103
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/7515 Shifting the patterns to accommodate for positional errors
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04M 1/0202 Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets constructional features of telephone transmitters or receivers, e.g. of speakers or microphones H04M1/03

Abstract

An identification method and process for objects from digitally captured images thereof that uses data characteristics to identify an object from a plurality of objects in a database. The data is broken down into parameters such as a Shape Comparison, Grayscale Comparison, Wavelet Comparison, and Color Cube Comparison with object data in one or more databases to identify the actual object of a digital image.

Claims

1. A system for addressing features in printed media, comprising:

a mobile device sensor configured to capture image data representative of at least a portion of a printed media; and

an identification platform communicatively coupled with the sensor and configured to;

obtain the image data from the sensor;

recognize the portion of the printed media as an object from the image data based on salient parameters derived from a visual appearance of the portion of the printed media in the image data;

determine position and orientation of the sensor with respect to the printed media at the time the image data was captured;

decode an address from the object as a function of the salient parameters and with respect to the position and orientation;

provide the address to a second device; and

enable the second device to execute a command based on the address.

2. The system of claim 1, wherein the address comprises an address of pertinent information.

3. The system of claim 1, wherein the position comprises a centroid position.

4. The system of claim 1, wherein the orientation is with respect to the object.

5. The system of claim 1, wherein the image data of the printed media comprises coded information.

6. The system of claim 5, wherein the identification platform is further configured to extract the coded information according to its type.

7. The system of claim 1, further comprising the second device, and wherein the second device comprises the identification platform.

8. The system of claim 1, wherein the image data comprises a symbol and the object.

9. The system of claim 8, wherein the symbol comprises at least one of the following:

alphanumeric characters, a code, a matrix, a bar code, a matrix code, and a 2D code.

10. The system of claim 1, wherein the identification platform is further configured to transfer information derived from the image data to a remote server.

11. The system of claim 10, wherein the information comprises alphanumeric characters.

12. The system of claim 1, wherein the object is associated with a location attribute that represents a location of the sensor.

13. The system of claim 1, wherein the object is associated with an orientation attribute.

14. The system of claim 1, wherein the sensor comprises a camera.

15. The system of claim 1, wherein the identification platform is remote from the second device.

16. The system of claim 1, wherein the identification platform is further configured to determine a location of the object.

17. The system of claim 1, wherein the identification platform is further configured to determine an orientation of the object.

18. The system of claim 1, wherein the identification platform is further configured to enable the second device to present content to a user based on the address.

19. A system for determining information associated with an object in an image, comprising:

a mobile device having at least one sensor configured to capture image data representative of at least a portion of a physical object;

a database storing a plurality of known objects, each of which comprises stored attributes;

an identification platform communicatively coupled with the device and the database and configured to;

obtain the image data from the sensor;

recognize the portion of the physical object as a known object from the image data based on parameters derived from a visual appearance of the physical object in the image data;

determine position and orientation of the mobile device with respect to the physical object at the time the image data was captured;

decode an address from the physical object as a function of the parameters and with respect to the position and orientation;

provide the address to the mobile device; and

enable the device to execute a command based on the address.

20. The system of claim 19, wherein the address comprises an address of pertinent information.

21. The system of claim 20, wherein the address of pertinent information comprises location information.

22. The system of claim 19, wherein the position comprises a centroid position.

23. The system of claim 19, wherein the mobile device comprises the identification platform.

24. The system of claim 19, wherein the identification platform is further configured to determine the position and orientation information of the mobile device with respect to the physical object based on an appearance of the physical object in the image data.

25. The system of claim 19, wherein the physical object comprises printed media.

26. The system of claim 19, wherein the orientation is with respect to the physical object.

27. The system of claim 19, wherein the image data of the physical object comprises coded information.

28. The system of claim 27, wherein the identification platform is further configured to extract the coded information according to its type.

29. The system of claim 19, wherein the image data comprises a symbol and the physical object.

30. The system of claim 29, wherein the symbol comprises at least one of the following:

alphanumeric characters, a code, a matrix, a bar code, a matrix code, and a 2D code.

31. The system of claim 19, wherein the identification platform is further configured to transfer information derived from the image data to a remote server.

32. The system of claim 31, wherein the information comprises alphanumeric characters.

33. The system of claim 19, wherein the object is associated with a location attribute that represents a location of the device.

34. The system of claim 19, wherein the physical object is associated with an orientation attribute.

35. The system of claim 19, wherein the sensor comprises a camera.

36. The system of claim 19, wherein the identification platform is remote from the device.

37. The system of claim 19, wherein the identification platform is further configured to determine a location of the physical object.

38. The system of claim 19, wherein the identification platform is further configured to determine an orientation of the physical object.

39. The system of claim 19, wherein the identification platform is further configured to enable the mobile device to present content to a user based on the address.

40. A system for identifying an object in an image, comprising:

a mobile device sensor configured to capture image data representative of at least a portion of a printed media; and

an identification platform communicatively coupled with the sensor and configured to;

obtain the image data from the sensor;

recognize the portion of the printed media as an object from the image data based on salient parameters derived from a visual appearance of the portion of the printed media in the image data;

determine position and orientation of the sensor with respect to the printed media at the time the image data was captured;

decode an address information from the object as a function of the salient parameters and with respect to the position and orientation;

provide the address information associated with the object to a second device, wherein the address information comprises a position of the portion of the printed media relative to the printed media; and

enable the second device to execute a command based on the address information.

41. The system of claim 40, wherein the address information further comprises an orientation of the portion of the printed media relative to the printed media.

42. A system for determining information associated with an object in an image, comprising:

a mobile device sensor configured to capture image data representative of at least a portion of a printed media; and

an identification platform communicatively coupled with the sensor and configured to;

obtain the image data from the sensor;

recognize the portion of the printed media as an object from the image data based on salient parameters derived from a visual appearance of the portion of the printed media in the image data;

determine position and orientation of the sensor with respect to the printed media at the time the image data was captured;

decode an address related to address information of the object as a function of the salient parameters and with respect to the position and orientation; and

provide the address information associated with the object to a device, wherein the address information comprises a time when the image data was captured; and

enable the device to execute a command based on the address information.

43. A system for determining information associated with an object in an image, comprising:

a mobile device sensor configured to capture image data representative of at least a portion of a printed media; and

an identification platform communicatively coupled with the sensor and configured to;

obtain the image data from the sensor;

recognize the portion of the printed media as an object from the image data based on salient parameters derived a visual appearance of the portion of the printed media in the image data;

determine position and orientation of the sensor with respect to the printed media at the time the image data was captured;

decode an address related to address information associated with the object as a function of the salient parameters and as a function of the position and orientation; and

provide the address information associated with the recognized object to a second device, wherein the address information comprises location information of the portion of the printed media relative to the printed media and a time the image was captured; and

enable the second device to execute a command based on the address information.