Fast feature detection by reducing an area of a camera image

• US 20130328760A1
• Filed: 06/08/2012
• Published: 12/12/2013
• Est. Priority Date: 06/08/2012
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: HONEA, William Keith
• Application Number:
  US13/492,686
• Publication Number:
  US 20130328760A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]

Abstract

An apparatus and method for a mobile device to reduce computer vision (CV) processing, for example, when detecting features and key points, is disclosed. Embodiments herein reduce the search area of an image or the volume of image data that is searched to detect features and key points. Embodiments limit a search area of a full image to an actual area of interest to the user. This reduction decreases the search area, decreases search time, decreases power consumption, and limits detection to the area of interest to the user.

Claims

1. A method for defining a search area for a computer vision algorithm, the method comprising:

displaying an image, captured by a camera, having a first area;

receiving a selection by a user of a portion of the image; and

defining, based on the portion of the image, a search area for a computer vision algorithm;

wherein a search by the computer vision algorithm is limited to an area within the search area; and

wherein the search area is reduced as compared to the first area.

2. The method of claim 1, further comprising recognizing an object in the image based on a result of the search.

3. The method of claim 2, wherein the search comprises searching the search area for key points.

4. The method of claim 3, wherein the computer vision algorithm comprises identifying features of the object based on the key points, and wherein the recognizing is based at least in part on matching the identified features to known features of the object.

5. The method of claim 1, further comprising performing the computer vision algorithm on a mobile device.

6. The method of claim 1, further comprising transmitting information regarding the search area to a remote device to perform at least part of the computer vision algorithm, wherein the transmitted information excludes at least a portion of the image outside of the search area.

7. The method of claim 1, further comprising operating an augmented reality application based at least in part on a result of the computer vision algorithm.

8. The method of claim 1, wherein the displaying comprises displaying the image on a touch screen, and wherein the receiving of the selection comprises receiving an input on the touch screen.

9. The method of claim 1, wherein the selection comprises at least one user defined line.

10. The method of claim 9, wherein the search area comprises a polygon.

11. The method of claim 9, wherein the search area comprises a circle.

12. The method of claim 9, wherein the search area comprises a free-form area.

13. The method of claim 1, wherein receiving the selection comprises accepting a tapping by the user.

14. The method of claim 1, wherein the search area comprises at least two disjoint regions of the image.

15. A mobile device to define a search area for a computer vision algorithm, the mobile device comprising:

a camera;

a user input device;

memory; and

a processor coupled to the camera, the user input device and the memory;

wherein the processor is coupled to receive images from the camera, to receive user input from the user input device, and to load and store data to the memory; and

wherein the memory comprises code, when executed on the processor, for;

displaying an image, captured by the camera, having a first area;

receiving a selection by a user, via the input device, of a portion of the image; and

defining, based on the portion of the image, a search area for a computer vision algorithm;

wherein a search by the computer vision algorithm is limited to an area within the search area; and

wherein the search area is reduced as compared to the first area.

16. The mobile device of claim 15, the code further comprises code for recognizing an object in the image based on a result of the search.

17. The mobile device of claim 16, wherein the search comprises searching the search area for key points.

18. The mobile device of claim 17, wherein the computer vision algorithm comprises identifying features of the object based on the key points, and wherein the recognizing is based at least in part on matching the identified features to known features of the object.

19. The mobile device of claim 15, the code further comprises code for performing the computer vision algorithm on a mobile device.

20. The mobile device of claim 15, the code further comprises code for transmitting information regarding the search area to a remote device to perform at least part of the computer vision algorithm, wherein the transmitted information excludes at least a portion of the image outside of the search area.

21. The mobile device of claim 15, the code further comprises code for operating an augmented reality application based at least in part on a result of the computer vision algorithm.

22. The mobile device of claim 15, wherein the search area comprises at least two disjoint regions of the image.

23. The mobile device of claim 15, wherein code for accepting the selection comprises code for drawing at least one user defined line.

24. The mobile device of claim 15, wherein the search area comprises a circle.

25. The mobile device of claim 15, wherein the search area comprises a free-form area.

26. The mobile device of claim 15, wherein code for receiving the selection comprises code for receiving a tapping by the user.

27. A mobile device to define a search area for a computer vision algorithm, the mobile device comprising:

means for displaying an image having a first area;

means for receiving a selection by a user of a portion of the image; and

means for defining, based on the portion of the image, a search area for a computer vision algorithm;

wherein a search by the computer vision algorithm is limited to an area within the search area; and

wherein the search area is reduced as compared to the first area.

28. The mobile device of claim 27, wherein means for accepting the selection comprises means for drawing at least one user defined line.

29. The mobile device of claim 27, wherein the search area comprises a circle.

30. The mobile device of claim 27, wherein the search area comprises a free-form area.

31. A non-transitory computer-readable medium including program code stored thereon, the program code comprising code for:

displaying an image having a first area;

receiving a selection by a user of a portion of the image; and

defining, based on the portion of the image, a search area for a computer vision algorithm;

wherein a search by the computer vision algorithm is limited to an area within the search area; and

wherein the search area is reduced as compared to the first area.

32. The non-transitory computer-readable medium of claim 31, wherein the code for accepting the selection comprises code for drawing at least one user defined line.

33. The non-transitory computer-readable medium of claim 31, wherein the search area comprises a circle.

34. The non-transitory computer-readable medium of claim 31, wherein the search area comprises a free-form area.