Camera apparatus and method for tracking object in the camera apparatus

• US 9,396,551 B2
• Filed: 10/26/2015
• Issued: 07/19/2016
• Est. Priority Date: 06/29/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kwon, Jung-Tae, Kim, Pyo-Jae, Na, Jin-Hee, Sohn, Jae-Sik, Yoon, Young-Kwon
• Primary Examiner(s): Johns, Andrew W
• Application Number:
  US14/922,989
• Publication Number:
  US 20160048976A1
• Time in Patent Office: 267 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values

Abstract

Disclosed is a camera apparatus capable of tracking a target object based on motion of a camera sensed by a motion sensor and a method for tracking an object in the camera apparatus are provided. The method includes obtaining, by a electronic device including a first sensor and a second sensor, one or more images corresponding to at least one object using the first sensor, by displaying the one or more images via a display operatively coupled with the electronic device, obtaining motion data corresponding to movement of at least part of the electronic device identified in relation with obtaining the one or more images, tracking, from a corresponding displayed image of the one or more images, a position corresponding to the at least one object based at least in part on the motion data, and presenting, via the display, at least one portion of information with respect to the position corresponding to the at least one object.

Claims

1. An apparatus comprising:

a first sensor;

a second sensor; and

a processor configured to;

obtain, using the first sensor, one or more images corresponding to at least one object, by displaying the one or more images via a display operatively coupled with the processor;

obtain, using the second sensor, motion data corresponding to movement of at least part of the apparatus identified in relation with obtaining the one or more images;

track, from a corresponding displayed image of the one or more images, a position corresponding to the at least one object based at least in part on the motion data; and

present, via the display, at least one portion of information with respect to the position corresponding to the at least one object.

2. The apparatus of claim 1, wherein the second sensor comprises at least one of an acceleration sensor, a gyroscope, and a magnetic sensor.

3. The apparatus of claim 1, wherein the processor is further configured to:

obtain data corresponding to a translation acceleration, a translation direction, or an angle of the first sensor as at least part of the motion data.

4. The apparatus of claim 1, wherein the processor is further configured to:

identify a pose of the at least one object based at least in part on the motion data.

5. The apparatus of claim 1, wherein the processor is further configured to:

identify an amount of the movement for each frame to be displayed.

6. The apparatus of claim 1, wherein the processor is further configured to:

determine whether the at least one object is located in the corresponding displayed image; and

generate at least part of the information based on the determination.

7. The apparatus of claim 1, wherein the processor is further configured to:

display an identifier corresponding to the at least one object based at least in part on a determination that the object is located in the corresponding displayed image.

8. The apparatus of claim 1, wherein the processor is further configured to:

display an indication of the position based at least in part on a determination that the at least one object is not located in the corresponding displayed image.

9. The apparatus of claim 1, wherein the processor is further configured to:

mark the object based at least in part on a determination that the at least one object is located in the corresponding displayed image and is not tracked.

10. The apparatus of claim 1, wherein the information comprises first information and second information, and wherein the processor is further configured to:

present at least one portion of the first information corresponding to a first position with respect to a first object; and

present at least one portion of the second information corresponding to a second position with respect to a second object.

11. A method comprising:

obtaining, by a electronic device including a first sensor and a second sensor, one or more images corresponding to at least one object using the first sensor, by displaying the one or more images via a display operatively coupled with the electronic device;

obtaining motion data corresponding to movement of at least part of the electronic device identified in relation with obtaining the one or more images;

tracking, from a corresponding displayed image of the one or more images, a position corresponding to the at least one object based at least in part on the motion data; and

presenting, via the display, at least one portion of information with respect to the position corresponding to the at least one object.

12. The method of claim 11, wherein obtaining the motion data comprises:

obtaining data corresponding to a translation acceleration, a translation direction, or an angle of the first sensor as at least part of the motion data.

13. The method of claim 11, wherein obtaining the motion data comprises:

identifying an amount of the movement for each frame to be displayed.

14. The method of claim 11, wherein the tracking comprises:

identifying a pose of the at least one object based at least in part on the motion data.

15. The method of claim 11, wherein the corresponding displayed image comprises a region of interest.

16. The method of claim 11, wherein the presenting comprises:

displaying an identifier corresponding to the at least one object based at least in part on a determination that the at least one object is located in the corresponding displayed image.

17. The method of claim 11, wherein the presenting comprises:

displaying an indication indicating the position of the at least one object based at least in part on a determination that the at least one object is not located in the corresponding displayed image.

18. The method of claim 11, wherein the presenting comprises:

marking the at least one object based at least in part on a determination that the object is located in the corresponding displayed image and is not tracked.

19. A non-transitory machine-readable storage device storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

obtaining, by a electronic device including a first sensor and a second sensor, one or more images corresponding to at least one object using the first sensor, by displaying the one or more images via a display operatively coupled with the electronic device;

obtaining motion data corresponding to movement of at least part of the electronic device identified in relation with the obtaining of the one or more images;

tracking, from a corresponding displayed image of the one or more images, a position corresponding to the at least one object based at least in part on the motion data; and

presenting, via the display, at least one portion of information with respect to the position corresponding to the at least one object.