User interface for providing feedback for handheld image capture

• US 8,937,666 B1
• Filed: 10/09/2012
• Issued: 01/20/2015
• Est. Priority Date: 10/09/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Padala, Sameer, Kimbembe, Andrews-Junior
• Primary Examiner(s): Moe, Aung S
• Assistant Examiner(s): COWAN, EUEL K
• Application Number:
  US13/647,722
• Time in Patent Office: 833 Days
• Field of Search: None
• US Class Current: 348/208.16
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/6811 based on the image signal

Abstract

A method may include capturing, by a computing device and during a time interval, a plurality of images. The computing device may determine a sharpness of a first image from the plurality of images based on detection of a difference between sharpness of a first plurality of high-contrast areas within the first image and sharpness of a corresponding, second plurality of high-contrast areas within a second image from the plurality of images. The first image may be sent to a search service. Image recognition data based on the first image or indication of unavailability of the image recognition data may be received from the search service. The determining may further include detecting a movement from at least a portion of the first plurality of high-contrast areas within the first image to a corresponding portion of the second plurality of high-contrast areas within the second image.

Claims

1. A method, comprising:

receiving, by a processor, a plurality of images captured by an image capturing device during a capture period of a predetermined amount of time;

identifying, by the processor, a feature located at a first position in a first image of the plurality of images and a second position in a second image of the plurality of images;

responsive to determining, by the processor, that the second position is more than a threshold distance from the first position, resetting the capture period prior to expiration of the predetermined amount of time;

sending the first image to a search service; and

receiving, from the search service, image recognition data based on the first image.

2. The method according to claim 1, further comprising providing a visual indication of remaining time within the capture period.

3. The method according to claim 2, further comprising, responsive to determining that the second position of the feature is more than the threshold distance from the first position of the feature, indicating, by at least a portion of the visual indication, a direction of movement of the feature, the direction of movement being determined based on the first position and the second position.

4. The method according to claim 1, wherein the image recognition data is received prior to expiration of the predetermined amount of time, and the image recognition data comprises one or more of text, barcode recognition data, logo recognition data, and artwork recognition data.

5. The method according to claim 1, further comprising:

classifying a first plurality of pixels within the first image into a first plurality of pixel buckets based on brightness, wherein the second plurality of pixels is associated with the feature; and

classifying a second plurality of pixels within the second image into a second plurality of pixel buckets based on brightness, wherein the second plurality of pixels is associated with the feature.

6. The method according to claim 5, further comprising:

resetting, by the processor, the capture period in response to detecting a brightness difference between a brightness of the feature within the first image and a brightness of the feature within the second image, the brightness difference being based on a comparison of at least a portion of the first plurality of pixel buckets and at least a portion of the second plurality of pixel buckets.

7. The method according to claim 1, further comprising:

responsive to determining, by the processor, that a difference in sharpness between the first image and the second image exceeds a threshold difference in sharpness, resetting the capture period prior to expiration of the predetermined amount of time.

8. A computing device, comprising:

a processor;

a memory operatively coupled to the processor and storing computer-executable code that, when executed by the processor, causes the computing device to;

receive a plurality of images captured by an image capturing device during a capture period of a predetermined amount of time;

identify a feature located at a first position in a first image of the plurality of images and a second position in a second image of the plurality of images;

responsive to determining that the second position is more than a threshold distance from the first position, reset the capture period prior to expiration of the predetermined amount of time;

send the first image to a search service; and

receive, from the search service, image recognition data based on the first image.

9. The computing device according to claim 8, wherein the memory further stores computer-executable code that, when executed by the processor, causes the computing device to:

provide a visual indication of remaining time within the capture period.

10. The computing device according to claim 9, wherein the memory further stores computer-executable code that, when executed by the processor, causes the computing device to:

responsive to determining that the second position of the feature is more than the threshold distance from the first position of the feature, indicate, by at least a portion of the visual indication, a direction of movement of the feature based on the first position of the feature and the second position of the feature.

11. The computing device according to claim 8, wherein the image recognition data is received prior to expiration of the predetermined amount of time, and wherein the image recognition data comprises one or more of text, barcode recognition data, logo recognition data, and artwork recognition data.

12. The computing device according to claim 8, wherein the memory further stores computer-executable code that, when executed by the processor, causes the computing device to:

classify a first plurality of pixels within the first image into a first plurality of pixel buckets based on brightness, wherein the second plurality of pixels is associated with the feature; and

classify a second plurality of pixels within the second image into a second plurality of pixel buckets based on brightness, wherein the second plurality of pixels is associated with the feature.

13. The computing device according to claim 12, wherein the memory further stores computer-executable code that, when executed by the processor, causes the computing device to:

reset the capture period in response to detecting a brightness difference between a brightness of the feature within the first image and a brightness of the feature within the second image, the brightness difference being determined based on a comparison of at least a portion of the first plurality of pixel buckets and at least a portion of the second plurality of pixel buckets.

14. The computing device according to claim 8, wherein the memory further stores computer-executable code that, when executed by the processor, causes the computing device to:

responsive to determining that a difference in sharpness between the first image and the second image exceeds a threshold difference in sharpness, reset the capture period prior to expiration of the predetermined amount of time.

15. A non-transitory, computer-readable storage medium, having stored thereon code that, when executed by a processor, cause a computing device to perform a method comprising:

receiving a plurality of images captured by an image capturing device during a capture period of a predetermined amount of time;

identify a feature located at a first position in a first image of the plurality of images and a second position in a second image of the plurality of images;

responsive to determining that the second position is more than a threshold distance from the first position, resetting the capture period prior to expiration of the predetermined amount of time;

sending the first image to a search service; and

receiving, from the search service, image recognition data based on the first image.

16. The computer-readable storage medium according to claim 15, wherein the method further comprises providing a visual indication of remaining time within the capture period.

17. The computer-readable storage medium according to claim 15, wherein the method further comprises:

responsive to determining that a difference in sharpness between the first image and the second image exceeds a threshold difference in sharpness, resetting the capture period prior to expiration of the predetermined amount of time.