Image tagging for capturing information in a transaction

• US 9,786,016 B2
• Filed: 02/28/2014
• Issued: 10/10/2017
• Est. Priority Date: 02/28/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Young, Kyle S.
• Primary Examiner(s): Danneman, Paul
• Application Number:
  US14/194,432
• Publication Number:
  US 20150248732A1
• Time in Patent Office: 1,320 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06Q 10/06398 Performance of employee with respect to a job function
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

An image is captured within an application transaction. Identifying information corresponding to the captured image is obtained and displayed for user confirmation. The identifying information is entered into an appropriate place within the transaction.

Claims

1. A computing system comprising:

a processor; and

memory storing instructions executable by the processor, wherein the instructions configure the computing system to;

receive, from a client device that is remote from the computing system;

an image associated with an application on the client device; and

an application context indicator indicative of a context of the application;

based on the application context indicator, determine an application task of the application, wherein the application task is associated with the received image;

generate a query for a matching image, the query including an indication of the received image;

obtain, from an image source, the matching image that matches the received image and a set of information associated with the matching image;

based on the application context, select a subset of information, from the identified set of information associated with the matching image; and

send the matching image and the subset of information to the client device.

2. The computing system of claim 1 wherein the application ask comprises a transaction, and wherein the subset of information comprises transactional information associated with performance of the transaction.

3. The computing system of claim 1 wherein the instructions configure the computing system to:

receive a plurality of images;

associate each of the plurality of images with corresponding information; and

store the plurality of images along with the associated information in the identified image source.

4. The computing system of claim 1 wherein the instructions configure the computing system to:

receive, from the client device, geographical location information corresponding to the received image; and

obtain, from the image source, a set of information associated with the geographical location information.

5. A computing system comprising:

a processor; and

memory storing instructions executable by the processor, wherein the instructions, when executed, configure the computing system to;

receive an image;

receive an application context indicator indicative of an application context of an application remotely executed from the computing system;

based on the application context indicator, determine a task that is associated with the received image and corresponds to the application context of the application;

based on the task, select an image source from a plurality of image sources;

identify a matching image that is stored in association with the selected image source and matches the received image;

based on the application context, obtain corresponding information that is pre-associated with the matching image and corresponds to the task; and

send the corresponding information to the application.

6. The computing system of claim 5, wherein the instructions configure the computing system to:

compare the received image to stored images by searching the selected image source to identify the matching image; and

send the matching image to the application.

7. The computing system of claim 5 wherein the selected image source comprises a first data store selected from a set of data stores, and wherein the instructions configure the computing system to:

prior to receiving the image,

receive a plurality of images;

associate each of the plurality of images with corresponding information; and

store the plurality of images along with the associated information in the first data store.

8. The computing system of claim 7, wherein the instructions configure the computing system to:

generate a query that includes an indication of the received image;

obtain the matching image by searching the first data store based on the query; and

identify the corresponding information that is associated with the matching image, the corresponding information being based on the application context indicator.

9. The computing system of claim 5, wherein the corresponding information is associated with the matching image before the image is received.

10. The computing system of claim 9, wherein corresponding information comprises information about an object depicted in the received image.

11. The computing system of claim 10, wherein the corresponding information identifies the object.

12. The computing system of claim 5, wherein the task comprises a transaction, and wherein the corresponding information comprises transactional information associated with performance of the transaction.

13. A computer-implemented method comprising:

receiving, at a computing system that is remote from a client device;

an image associated with an application on the client device; and

an application context indicator indicative of a context of the application;

based on the application context indicator, determining an application task of the application, the application task being associated with the received image;

generating a query for a matching image, the query including an indication of the received image;

obtaining, from an image source, the matching image that matches the received image and a set of information associated with the matching image;

based on the application context, selecting a subset of information, from the identified set of information associated with the matching image; and

sending the matching image and the subset of information to the client device.

14. The computer-implemented method of claim 13, further comprising:

based on the application task, selecting the image source from a plurality of image sources.

15. The computer-implemented method of claim 14, wherein the selected image source comprises a data store, and the method further comprises:

prior to receiving the image,

receiving a plurality of images;

associating each of the plurality of images with corresponding information; and

storing the plurality of images along with the associated information in the data store.

16. The computer-implemented method of claim 13, wherein the set of information was associated with the matching image prior to receiving the image from the client device.

17. The computer-implemented method of claim 13, wherein the set of information comprises information about an object depicted in the received image.

18. The computer-implemented method of claim 17, wherein the identified-set of information identifies the object.

19. The computer-implemented method of claim 18, wherein the object represents at least one of a person or a transaction item.

20. The computer-implemented method of claim 13, wherein the task comprises a transaction, and wherein the subset of information comprises transactional information associated with performance of the transaction.