Method and apparatus for determining region of interest of image

• US 9,965,859 B2
• Filed: 12/07/2015
• Issued: 05/08/2018
• Est. Priority Date: 12/05/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Geon-Soo, Yeom, Dong-Hyun, Jeon, Yong-Joon, Hwang, Min-Kyung
• Primary Examiner(s): BELLA, MATTHEW C
• Assistant Examiner(s): Shin, Soo
• Application Number:
  US14/961,407
• Publication Number:
  US 20160163036A1
• Time in Patent Office: 883 Days
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

Disclosed is a method for determining a region of interest (ROI) from an image. The method includes obtaining a wearing portion of a first electronic device, obtaining a first image related to a user wearing the first electronic device, and determining the ROI from the first image based on the obtained wearing portion.

Claims

1. An operation method of an electronic device, comprising:

receiving, by a communication device of the electronic device, identification information of a first electronic device, through a communication with the first electronic device;

determining, by a processor of the electronic device, a wearing portion of a body of a user corresponding to the first electronic device based on the identification information of the first electronic device;

obtaining, by a camera of the electronic device, a first image related to the user wearing the first electronic device;

determining, by the processor of the electronic device, a portion of the first image to be processed from the first image based on the determined wearing portion, the portion of the first image including an object corresponding to at least part of the determined wearing portion of the body of the user;

performing, by the processor of the electronic device, image processing on the determined portion of the first image and identifying a movement of the determined wearing portion of the body of the user based on a result of the image processing; and

performing, by the processor of the electronic device, an event based on the movement of the determined wearing portion of the body of the user.

2. The method of claim 1, wherein the wearing portion is determined based on the first electronic device and association information on a wearing portion corresponding to the first electronic device.

3. The method of claim 1, wherein determining the portion of the first image to be processed includes:

detecting, by the processor of the electronic device, at least one region corresponding to the wearing portion from the first image; and

determining, by the processor of the electronic device, the portion of the first image to be processed corresponding to the detected at least one region.

4. The method of claim 1, further comprising obtaining, by the communication device of the electronic device, motion information on the first electronic device.

5. The method of claim 4, wherein the portion of the first image to be processed corresponding to the first electronic device is determined when the first electronic device moves outside a pre-determined threshold.

6. The method of claim 4, wherein the portion of the first image to be processed is determined based on the obtained motion information and the wearing portion.

7. The method of claim 1, further comprising obtaining, by the communication device of the electronic device, first information detected by the first electronic device.

8. The method of claim 7, wherein the portion of the first image to be processed is determined based on the wearing portion and a type of the first information.

9. The method of claim 7, further comprising:

obtaining, by the processor of the electronic device, second information by processing the portion of the first image to be processed; and

obtaining, by the processor of the electronic device, third information based on the first information and the second information.

10. The method of claim 1, further comprising executing, by the processor of the electronic device, a first application using a result of processing the portion of the first image to be processed, wherein the portion of the first image to be processed is determined based on the wearing portion and data from the first application.

11. The method of claim 1, further comprising:

detecting, by the processor of the electronic device, a change of the wearing portion of the first electronic device; and

re-determining, by the processor of the electronic device, the portion of the first image to be processed based on the changed wearing portion.

12. The method of claim 1, further comprising:

detecting, by the processor of the electronic device, another region in the first image that is related to the portion of the first image to be processed; and

additionally including, by the processor of the electronic device, the another detected region as another portion of the first image to be processed.

13. An apparatus comprising:

a communication device;

a camera; and

a processor configured to;

receive identification information of a first electronic device, through the communication device,

determine a wearing portion of a body of a user corresponding to the first electronic device based on the identification information of the first electronic device,

control the camera to obtain a first image related to the user wearing the first electronic device,

determine a portion of the first image to be processed from the first image based on the determined wearing portion,

perform image processing on the determined portion of the first image and identify a movement of the determined wearing portion of the body of the user based on a result of the image processing, and

perform an event based on the movement of the determined wearing portion of the body of the user,

wherein the portion of the first image includes an object corresponding to at least part of the determined wearing portion of the body of the user.

14. The apparatus of claim 13, wherein the processor is configured to determine the wearing portion based on the first electronic device and association information of a wearing portion corresponding to the first electronic device.

15. The apparatus of claim 13, wherein the processor is configured to detect at least one region corresponding to the wearing portion from the first image and determine the portion of the first image to be processed corresponding to the detected at least one region.

16. The apparatus of claim 13, wherein the processor is configured to obtain motion information on the first electronic device.

17. The apparatus of claim 16, wherein the processor is configured to determine the portion of the first image to be processed corresponding to the first electronic device when the first electronic device moves outside a pre-determined threshold.

18. An operation method of an electronic device, the method comprising:

receiving, by a communication device of the electronic device, identification information of at least one electronic device, through a communication with the at least one electronic device;

obtaining, by a camera of the electronic device, a first image related to a user wearing the at least one electronic device;

determining, by the processor of the electronic device, each wearing portion of a body of the user wearing the at least one electronic device based on the identification information;

determining, by the processor of the electronic device, a portion of the first image to be processed from the first image using a wearing portion of a first electronic device from which a motion is detected among the at least one electronic device, the portion of the first image including an object corresponding to at least part of the determined wearing portion of the body of the user;

performing, by the processor of the electronic device, image processing on the determined portion of the first image and identifying a movement of the determined wearing portion of the body of the user based on a result of the image processing; and

performing, by the processor of the electronic device, an event based on the movement of the determined wearing portion of the body of the user.