Image tagging for capturing information in a transaction

• US 10,650,471 B2
• Filed: 09/05/2017
• Issued: 05/12/2020
• Est. Priority Date: 02/28/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Young, Kyle S.
• Primary Examiner(s): Danneman, Paul
• Application Number:
  US15/695,724
• Publication Number:
  US 20180089765A1
• Time in Patent Office: 980 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06Q 10/06398 Performance of employee with respect to a job function
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

An image is captured within an application transaction. Identifying information corresponding to the captured image is obtained and displayed for user confirmation. The identifying information is entered into an appropriate place within the transaction.

Claims

1. A computing system comprising:

a processor; and

memory storing instructions executable by the processor, wherein the instructions configure the computing system to;

receive, from a client device that is remote from the computing system;

image data representing a first image associated with an application on the client device; and

context data that identifies an operational context of the application and is indicative of a task to be performed in the application relative to the first image;

based on the first image and the application context,

select, from an image source, a second image based on a correspondence between the second image and the first image;

obtain information associated with the second image; and

send the second image and the information to the client device.

2. The computing system of claim 1, wherein the context data comprises non-image data that is received from the client device in addition to the image data, and the context data identifies a user-selected operation in the application on the client device.

3. The computing system of claim 2, wherein the instructions configure the computing system to:

based on the application context, select a subset of information from a set of information associated with the second image; and

send the second image and the subset of information to the client device.

4. The computing system of claim 1 wherein the instructions configure the computing system to:

receive a plurality of images;

associate each of the plurality of images with corresponding information; and

store the plurality of images along with the associated information in the image source.

5. The computing system of claim 1 wherein the application context indicates a geographical location associated with the client device, and the instructions configure the computing system to:

obtain, from the image source, information associated with the geographical location.

6. A computing system comprising:

a processor; and

memory storing instructions executable by the processor, wherein the instructions, when executed, configure the computing system to;

receive an image associated with an application on a client device that is remote from the computing system;

determine an application context that is associated with the first image and indicative of a task to be performed in the application relative to the first image;

based on the application context, select an image source from a plurality of image sources;

identify a second image that is stored in association with the selected image source and corresponds to the first image;

obtain information that is pre-associated with the second image; and

send the information to the application.

7. The computing system of claim 6, wherein the instructions configure the computing system to:

receive an application context indicator indicative of the application context of the application;

compare the first image to stored images by searching the selected image source to identify the second image; and

send the second image to the application.

8. The computing system of claim 6 wherein the selected image source comprises a first data store selected from a set of data stores, and wherein the instructions configure the computing system to:

prior to receiving the first image from the application,

receive a plurality of images;

associate each of the plurality of images with corresponding information; and

store the plurality of images along with the associated information in the first data store.

9. The computing system of claim 8, wherein the instructions configure the computing system to:

generate a query that includes an indication of the first image;

obtain the second image by searching the first data store based on the query; and

identify the information that is associated with the second image.

10. The computing system of claim 6, wherein the information is associated with the second image before the first image is received from the client device.

11. The computing system of claim 10, wherein information comprises information about an object depicted in the received image.

12. The computing system of claim 6, wherein the information comprises transactional information associated with performance of a transaction.

13. A method performed by a computing system, the method comprising:

receiving, from a client device that is remote from the computing system, image data representing a first image associated with an application on the client device;

receiving, from the client device in addition to the image data, context data that identifies a context of the application on the client device and is indicative of a user-selected operation associated with the first image in the application;

based on the first image and the application context,

obtaining, from an image source, a second image that corresponds to the first image; and

obtaining information associated with the second image; and

sending the second image and the information to the client device.

14. The method of claim 13, further comprising:

based on the context, selecting the image source from a plurality of image sources.

15. The method of claim 14, wherein the selected image source comprises a data store associated with the computing system, and the method further comprises:

prior to receiving the first image from the client device,

receiving a plurality of images;

associating each of the plurality of images with corresponding information; and

storing the plurality of images along with the associated information in the data store.

16. The method of claim 13, and further comprising:

receiving, from the client device, a context indicator indicative of the context of the application;

determining the task based on the context; and

obtaining the information based on the task.

17. The method of claim 13, and further comprising:

based on the context, selecting a subset of information from a set of information associated with the matching image; and

sending the second image and the subset of information to the client device.

18. The method of claim 13, wherein the information comprises information about an object depicted in the first image.

19. The method of claim 18, wherein the object represents at least one of a person or a transaction item.

20. The method of claim 13, wherein the context data comprises non-image data received, from the client device, separate from the image data.