Method for recognizing a specific object inside an image and electronic device thereof

• US 9,767,359 B2
• Filed: 11/24/2014
• Issued: 09/19/2017
• Est. Priority Date: 11/22/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Son, Dong-Il, Cheong, Cheol-Ho
• Primary Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US14/551,861
• Publication Number:
  US 20150146925A1
• Time in Patent Office: 1,030 Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60

Abstract

A method and an apparatus for recognizing a specific object inside an image in an electronic device are provided. The method includes displaying at least one image; detecting at least one gesture; selecting a recognition function related to at least one object existing in the at least one image according to the detected at least one gesture; and recognizing the at least one object using the selected recognition function.

Claims

1. A method for recognizing a specific object inside an image in an electronic device, the method comprising:

displaying an image comprising at least one object;

detecting at least one gesture on the displayed image;

designating, in response to the detected at least one gesture, an object region in the displayed image and determining a recognition function for recognizing the designated object region; and

recognizing the designated object region using the determined recognition function.

2. The method of claim 1, wherein the recognition function includes at least one of character recognition, barcode recognition, face recognition, and two-dimensional image code recognition.

3. The method of claim 1, wherein determining the recognition function comprises:

designating the object region in the image according to a first gesture; and

selecting an object recognition module for analyzing the object region according to a second gesture.

4. The method of claim 3, wherein the object region is designated by a predetermined region determination reference based on position information of a location where the first gesture has been input or a pattern of the first gesture.

5. The method of claim 4, wherein the predetermined region determination reference includes at least one of a size of the object inside the image, a distance between an image-pick up device and the object, a position, pattern density, brightness, and a length of an edge.

6. The method of claim 3, wherein the second gesture is mapped to a specific object recognition module.

7. The method of claim 3, further comprising:

performing focusing using the designated object region as a reference.

8. The method of claim 3, further comprising:

adjusting at least one of brightness, sharpness, contrast, and an exposure time using the designated object region as a reference to enhance image quality.

9. The method of claim 3, further comprising:

displaying a user interface informing that the object region has been designated; and

tracking a position of the designated object region.

10. The method of claim 1, wherein determining the recognition function comprises:

designating the object region in the image based on position information of a location where the detected at least one gesture has been input or a pattern of the detected gesture; and

selecting an object recognition module for analyzing the designated object region.

11. The method of claim 10, wherein selecting the object recognition module for analyzing the designated object region comprises:

analyzing a pattern of an object corresponding to a pattern path of the detected gesture on the designated object region; and

selecting an object recognition module corresponding to the analyzed pattern.

12. The method of claim 10, wherein designating the object region comprises:

analyzing a pattern of an object corresponding to a pattern path of the gesture on the designated object region; and

inferring a direction, a slope, or a region of an object corresponding to the analyzed pattern.

13. The method of claim 10, wherein selecting the object recognition module for analyzing the designated object region comprises:

selecting an object recognition module corresponding to a pattern of the gesture on the designated object region.

14. The method of claim 1, further comprising, before recognizing the designated object region:

displaying a list of recognition functions for recognizing the designated object region; and

selecting one function from the displayed list of recognition functions.

15. The method of claim 1, further comprising:

displaying, after recognizing the designated object region, results of the recognition or a list of application related to the recognition results.

16. An electronic device comprising:

at least one processor; and

at least one memory,

wherein the at least one memory comprises instructions that when executed, cause the at least one processor to;

display an image comprising at least one object,

detect at least one gesture on the displayed image,

in response to the detected at least one gesture, designate an object region in the displayed image and determine a recognition function for recognized the designated object region, and

recognize the selected designated object region using the determined recognition function.

17. The electronic device of claim 16, wherein the recognition function includes at least one of character recognition, barcode recognition, face recognition, and two-dimensional image code recognition.

18. The electronic device of claim 16, wherein the instruction configured to determine the recognition function related comprises:

an instruction configured to designate the object region in the image according to a first gesture; and

an instruction configured to select an object recognition module for analyzing the object region according to a second gesture.

19. The electronic device of claim 18, wherein the object region is designated by a predetermined region determination reference based on position information of a location where the first gesture has been input or a pattern of the first gesture.

20. The electronic device of claim 19, wherein the predetermined region determination reference includes at least one of a size of the object inside the image, a distance between an image-pick up device and the object, a position, pattern density, brightness, and a length of an edge.

21. The electronic device of claim 18, wherein the second gesture is mapped to a specific object recognition module.

22. The electronic device of claim 18, wherein the at least one memory further comprises an instruction configured to perform focusing using the designated object region as a reference.

23. The electronic device of claim 18, wherein the at least one memory further comprises an instruction configured to adjust at least one of brightness, sharpness, contrast, and an exposure time using the designated object region as a reference to enhance image quality.

24. The electronic device of claim 16, wherein the instruction configured to determine the recognition function comprises:

an instruction configured to designate the object region in the image based on position information of a location where the detected gesture has been input or a pattern of the gesture; and

an instruction configured to select an object recognition module for analyzing the designated object region.

25. The electronic device of claim 24, wherein the instruction configured to select the object recognition module for analyzing the designated object region includes:

an instruction configured to select an object recognition module corresponding to a pattern of the detected gesture on the designated object region.

26. The electronic device of claim 16, wherein the at least one memory further comprises:

an instruction configured to display, before recognizing the designated object region, a list of recognition functions related to for recognizing the designated object region; and

an instruction configured to detect a selection of one function from the displayed list of recognition functions.

27. The electronic device of claim 16, wherein the processor further comprises:

an instruction configured to display, after recognizing the selected designated object region, results of the recognition;

or

an instruction configured to display a list of at least one application related to the recognition results.

28. The electronic device of claim 27, wherein the instruction configured to display the list comprises an instruction configured to:

generate the recognition results or the list to display in a virtual three-dimensional model,

recognize camera pose information using a distribution shape of an object image,

transform the three-dimensional model such that it is suitable for the camera pose information and a distribution shape of a code image, and

display the model translucently or opaquely adjacent to or on the code image.