Object information derived from object images

• US 9,031,290 B2
• Filed: 01/21/2014
• Issued: 05/12/2015
• Est. Priority Date: 11/06/2000
• Status: Expired due to Fees

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Boncyk, Wayne C., Cohen, Ronald H.
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US14/160,263
• Publication Number:
  US 20140133712A1
• Time in Patent Office: 476 Days
• Field of Search: 382/100, 382/115, 382/305, 382117-118, 705 261- 272
• US Class Current: 382/118
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/24554 Unary operations; Data partitioning operations
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 16/904 Browsing; Visualisation therefor for navigating the web G06F16/954; browsing optimisation for the web G06F16/957
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 18/25 Fusion techniques
• CPC Class Codes: G06F 2218/08 Feature extraction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 30/0601 : Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0613 : Third-party assisted
• CPC Class Codes: G06Q 30/0623 : Item investigation
• CPC Class Codes: G06Q 30/0625 : Directed, with specific intent or strategy
• CPC Class Codes: G06Q 30/0635 : Processing of requisition or of purchase orders
• CPC Class Codes: G06T 7/00 : Image analysis
• CPC Class Codes: G06V 10/10 : Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 10/255 : Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 10/768 : using context analysis, e.g. recognition aided by known co-occurring patterns
• CPC Class Codes: G06V 20/00 : Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/10 : Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/20 : in augmented reality scenes
• CPC Class Codes: G06V 20/46 : Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/80 : Recognising image objects characterised by unique random patterns
• CPC Class Codes: G06V 2201/07 : Target detection
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/18 : Eye characteristics, e.g. of the iris
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/44 : Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

Search terms are derived automatically from images captured by a camera equipped cell phone, PDA, or other image capturing device, submitted to a search engine to obtain information of interest, and at least a portion of the resulting information is transmitted back locally to, or nearby, the device that captured the image.

Claims

1. A portable biometric iris recognition device comprising:

an image sensor configured to capture video data of a person'"'"'s iris;

an image processing platform coupled with the image sensor and configured to;

obtain the video data from the image sensor;

decompose the video data into quantifiable parameters associated with the iris;

recognize the iris by matching the quantifiable parameters to a known target object, wherein the known target object is a known person;

obtain information pertinent to the known person, wherein the information enables a second device to conduct an account interaction with an account via an address related to the information; and

a device connection coupled with the image processing platform and configured to send the information to the second device via the address.

2. The device of claim 1, wherein the device connection comprises a wired connection.

3. The device of claim 1, wherein the device connection comprises a wireless connection.

4. The device of claim 1, wherein the video data is representative of objects having biometric information.

5. The device of claim 4, wherein the video data further includes a representation of at least one of the following biometric information:

a fingerprint pattern and a face.

6. The device of claim 1, wherein the portable device further comprises a security camera that includes the image sensor, the image processing platform, and the device connection.

7. The device of claim 1, wherein the portable device further comprises a mobile handheld device that includes the image sensor, the image processing platform, and the device connection.

8. The device of claim 1, wherein the image sensor is configured to scan a person'"'"'s face to obtain the video data.

9. The device of claim 1, wherein the video data comprises high resolution image data.

10. The device of claim 1, wherein the video data comprises video data in one of the following formats:

MPEG and AVI.

11. The device of claim 1, wherein the information comprises a code.

12. The device of claim 1, wherein the account interaction comprises a transaction.

13. The device of claim 1, wherein the account comprises an account linked to the device.

14. The device of claim 1, wherein the account comprises an account linked to the known person.

15. The device of claim 1, wherein the account comprises an account linked to a terminal.

16. The device of claim 1, wherein the account comprises an account linked to a credit card.

17. The device of claim 1, wherein the account comprises a bank account.

18. The device of claim 1, wherein the information pertinent to the known person includes an identity.

19. The device of claim 18, wherein the information pertinent to the known person further enables the second device to present the identity.

20. The device of claim 19, wherein information pertinent to the known person further enables the second device to present the identity to at least one of the following:

a human user, a software component, and an application.

21. The device of claim 1, wherein the information pertinent to the known person is obtained as a function of a location of the known person.

22. The device of claim 1, wherein the information pertinent to the known person is obtained as a function of a time the video data was captured.

23. A facial recognition apparatus comprising:

a mobile device image sensor configured to capture image data of a person'"'"'s face;

an image processing platform coupled with the image sensor and configured to;

obtain the image data from the image sensor;

decompose the image data into quantifiable parameters associated with the face;

construct a query targeting an indexing system of an on-line database of known target objects including a first target object based on the quantifiable parameters;

recognize the face as the first target object by sending the query to the on-line database of known target objects, wherein the first target object is a known person;

obtain information pertinent to the known person in response to the query, wherein the information includes an address that enables a device to contact the known person; and

a device connection coupled with the image processing platform and configured to interact with the information through the device based on the address.

24. The apparatus of claim 23, wherein the mobile device image sensor is configured to scan a person'"'"'s face.

25. The apparatus of claim 23, wherein the mobile device image sensor comprises a camera.

26. The apparatus of claim 23, wherein the image data comprise at least one of the following:

a single image, multiple images, motion imagery, and a video.

27. The apparatus of claim 23, wherein the query comprises terms based on sign language translated from the image data.

28. The apparatus of claim 23, wherein the apparatus further comprises a portable device that includes the mobile device image sensor, the image processing platform, and the device connection.

29. The apparatus of claim 23, wherein the device connection includes at least one of the following:

a network connection, a cellular telephone, a wired connection, and a wireless connection.

30. The apparatus of claim 23, wherein the address comprises at least one of the following:

a phone number, a web site address, a URL, a URI, an IP address, a radio channel, a television channel, and a physical address.

31. The apparatus of claim 23, wherein the address comprises an interactive address.

32. The apparatus of claim 23, wherein the information pertinent to the known person is obtained at least in part based on a location.

33. The apparatus of claim 32, wherein the location comprises at least one of the following:

a device location, a GPS location, a person'"'"'s location, and a vehicle location.

34. The apparatus of claim 23, wherein the information pertinent to the known person is obtained at least in part based on a time the image data was captured.

35. The apparatus of claim 23, wherein the apparatus further comprises a security camera that includes the mobile device image sensor, the image processing platform, and the device connection.

36. The apparatus of claim 23, wherein the information pertinent to the known person includes an identity.

37. The apparatus of claim 36, wherein the information pertinent to the known person further enables the device to present the identity.

38. The apparatus of claim 37, wherein information pertinent to the known person further enables the device to present the identity to at least one of the following:

a human user, a software component, and an application.

39. The apparatus of claim 23, wherein the information pertinent to the known person further enables the device to have an account interaction with an account.

40. The apparatus of claim 39, wherein the account comprises at least one of the following:

an account linked to a person, an account linked to the device, a bank account, and an account linked to a credit card.