Object information derived from object images

• US 10,089,329 B2
• Filed: 09/21/2017
• Issued: 10/02/2018
• Est. Priority Date: 11/06/2000
• Status: Expired due to Term

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Boncyk, Wayne C., Cohen, Ronald H.
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US15/711,326
• Publication Number:
  US 20180011877A1
• Time in Patent Office: 376 Days
• Field of Search: 382100, 382165, 382181, 382224, 382305, 705 261- 271
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/24554 Unary operations; Data partitioning operations
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 16/904 Browsing; Visualisation therefor for navigating the web G06F16/954; browsing optimisation for the web G06F16/957
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 18/25 Fusion techniques
• CPC Class Codes: G06F 2218/08 Feature extraction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 30/0601 : Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0613 : Third-party assisted
• CPC Class Codes: G06Q 30/0623 : Item investigation
• CPC Class Codes: G06Q 30/0625 : Directed, with specific intent or strategy
• CPC Class Codes: G06Q 30/0635 : Processing of requisition or of purchase orders
• CPC Class Codes: G06T 7/00 : Image analysis
• CPC Class Codes: G06V 10/10 : Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 10/255 : Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 10/768 : using context analysis, e.g. recognition aided by known co-occurring patterns
• CPC Class Codes: G06V 20/00 : Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/10 : Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/20 : in augmented reality scenes
• CPC Class Codes: G06V 20/46 : Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/80 : Recognising image objects characterised by unique random patterns
• CPC Class Codes: G06V 2201/07 : Target detection
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/18 : Eye characteristics, e.g. of the iris
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/44 : Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

An object is recognized from image data as a target object and linked to a user based on an interaction by the user, information about the target object is obtained and a purchase of the target object is initiated.

Claims

1. A system comprising at least one non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to:

receive, from an image sensor of a camera device, image data containing a digital representation of a real-world object;

derive image characteristics of the real-world object from the digital representation of the real-world object in the image data;

recognize the real-world object as a target object based on the derived image characteristics;

link the target object to a user based on the user'"'"'s interaction with the target object;

obtain, from a content server, information about the target object from an information address associated with the target object; and

initiate, via a computer terminal, a purchase transaction for the purchase of the target object based on the information about the target object.

2. The system of claim 1, further comprising instructions that, when executed by the at least one processor, further cause the at least one processor to bill an amount of the purchase to an account linked to the user.

3. The system of claim 2, wherein the account comprises at least one of a bank account and a credit card account.

4. The system of claim 1, wherein the instructions that cause the at least one processor to initiate the purchase transaction comprise instructions that, when executed by the at least one processor, cause the at least one processor to initiate, via the computer terminal, the purchase transaction via an online transaction.

5. The system of claim 1, wherein the information about the target object comprises at least one of a name of the target object and a price for the target object.

6. The system of claim 1, further comprising instructions that, when executed by the at least one processor, cause the at least one processor to present the information about the target object to the user via the computer terminal.

7. The system of claim 6, wherein the instructions that cause the at least one processor to initiate the purchase transaction further comprise instructions that, when executed by the at least one processor, cause the at least one processor to initiate, via the computer terminal, the purchase transaction in response to a user interaction with the terminal.

8. The system of claim 1, wherein the instructions that cause the at least one processor to initiate, via the computer terminal, the purchase transaction further comprise instructions that, when executed by the at least one processor, further cause the at least one processor to initiate, via the computer terminal, the purchase transaction using a location.

9. The system of claim 8, wherein the location comprises at least one of the following:

a location of a person, a vehicle location, a physical location, a device location, a global positioning system location, a user location, and a vendor location.

10. The system of claim 1, wherein the image sensor comprises a camera.

11. The system of claim 10, wherein the camera comprises a digital camera.

12. The system of claim 10, wherein the camera comprises a video camera.

13. The system of claim 1, wherein the image data includes at least one of the following:

a single image, a series of images, a video, and a video stream.

14. The system of claim 1, wherein the information about the target object includes a code and wherein the instructions further comprise instructions that cause the at least one processor to initiate the purchase transaction using the code.

15. A method for image-based transaction execution, comprising:

receiving, by a server and from an image sensor of a camera device, image data containing a digital representation of a real-world object;

deriving, by the server, image characteristics of the real-world object from the digital representation of the real-world object in the image data;

recognizing, by the server, the real-world object as a target object based on the derived image characteristics;

linking, by the server, the target object to a user based on the user'"'"'s interaction with the target object;

obtaining, by the server and from a content server, information about the target object from an information address associated with the target object; and

initiating, by a computer terminal, a purchase transaction for the purchase of the target object based on the information about the target object.

16. The method of claim 15, further comprising billing an amount of the purchase to an account linked to the user.

17. The method of claim 16, wherein the account comprises at least one of a bank account and a credit card account.

18. The method of claim 15, wherein initiating the purchase transaction comprises initiating, by the server, the purchase transaction via an online transaction.

19. The method of claim 15, wherein the information about the target object comprises at least one of a name of the target object and a price for the target object.

20. The method of claim 15, further comprising presenting, via the computer terminal, the information about the target object to the user.

21. The method of claim 20, wherein initiating the purchase transaction further comprises initiating, by the computer terminal, the purchase transaction in response to a user interaction with the computer terminal.

22. The method of claim 15, wherein initiating the purchase transaction further comprises initiating, by the computer terminal, the purchase transaction using a location.

23. The method of claim 22, wherein the location comprises at least one of the following:

a location of a person, a vehicle location, a physical location, a device location, a global positioning system location, a user location, and a vendor location.

24. The method of claim 15, wherein the image sensor comprises a camera.

25. The method of claim 24, wherein the camera comprises a digital camera.

26. The method of claim 24, wherein the camera comprises a video camera.

27. The method of claim 15, wherein the image data includes at least one of the following:

a single image, a series of images, a video, and a video stream.

28. The method of claim 15, wherein the information about the target object includes a code and the method further comprises initiating, by the computer terminal, the purchase transaction using the code.