METHOD AND APPARATUS FOR GENERATING MOTION INFORMATION

• US 20120105326A1
• Filed: 09/24/2011
• Published: 05/03/2012
• Est. Priority Date: 11/03/2010
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: JEONG, Ki-jun, RYU, Hee-seob, PARK, Seung-kwon, SEO, Young-kwang, MIKIYAS, Teshome
• Application Number:
  US13/244,310
• Publication Number:
  US 20120105326A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45

Abstract

Provided are a method and an apparatus for generating motion information relating to motion of an object to provide reaction of a user interface to the motion of the object. The method for generating the motion information includes: detecting depth information of the object using an image frame acquired by capturing the object through a sensor; generating the motion information by compensating a determined size of the motion of the object in the acquired image frame based on the detected depth information; and generating an event corresponding to the generated motion information.

Claims

1. A method for generating motion information relating to a motion of an object to provide reaction of a user interface to the motion of the object, the method comprising:

detecting depth information of the object using an image frame acquired by capturing the object through a sensor;

generating the motion information by compensating a determined size of the motion of the object in the acquired image frame based on the detected depth information; and

generating an event corresponding to the generated motion information.

2. The method of claim 1, wherein the generating the motion information comprises:

when the object has a same actual motion size at different locations having different depth information in a field of view of the sensor, compensating the determined size of the motion based on the depth information so as to be equal at the different locations.

3. The method of claim 1, wherein the generating the motion information comprises:

obtaining the compensated size of the motion by compensating the determined size of the motion of the object in the acquired image frame with a value proportional to a depth indicated by the detected depth information.

4. The method of claim 3, wherein the obtaining the compensated size comprises obtaining the compensated size of the motion according to:

Δ

x_r=Δ

x₀·

C_H(2·

d·

tan θ

_H),

Δ

y_r=Δ

y₀·

C_V(2·

d·

tan θ

_V)

where Δ

x_r denotes a horizontal size for the compensated size of the motion, Δ

y_r denotes a vertical size for the compensated size of the motion, Δ

x₀ denotes a horizontal size for the determined size of the motion of the object in the acquired image frame, Δ

y₀ denotes a vertical size for the determined size of the motion of the object in the acquired image frame, d denotes the depth indicated by the depth information, θ

_H is ½

of a horizontal field of view of the sensor, θ

_V is ½

of a vertical field of view of the sensor, and C_H and C_V each denote a constant.

5. The method of claim 1, wherein the generated event comprises, as the reaction of the user interface, at least one of display power-on, display power-off, display of menu, movement of a cursor, change of an activated item, selection of an item, an operation corresponding to an item, a display channel change, and sound modification.

31. A computer readable recording medium having recorded thereon a program executable by a computer for performing the method of claim 1.

6. An apparatus for generating motion information relating to a motion of an object to provide reaction of a user interface to the motion of the object, the apparatus comprising:

a sensor which acquires an image frame by capturing the object; and

a controller which detects depth information of the object, generates the motion information by compensating a determined size of the motion of the object in the acquired image frame based on the detected depth information, and generates an event corresponding to the generated motion information.

7. The apparatus of claim 6, wherein the controller comprises:

a generator which, when the object has a same actual motion size at different locations having different depth information in a field of view of the sensor, generates the motion information by compensating the determined size of the motion using the depth information so as to be equal at the different locations.

8. The apparatus of claim 6, wherein the controller comprises:

a generator which obtains the compensated size of the motion by compensating the determined size of the motion of the object in the acquired image frame with a value proportional to a depth indicated by the detected depth information.

9. The apparatus of claim 8, wherein the generator obtains the compensated size of the motion according to:

Δ

x_r=Δ

x₀·

C_H(2·

d·

tan θ

_H),

Δ

y_r=Δ

y₀·

C_V(2·

d·

tan θ

_V)

where Δ

x_r denotes a horizontal size for the compensated size of the motion, Δ

y_r denotes a vertical size for the compensated size of the motion, Δ

x₀ denotes a horizontal size for the determined size of the motion of the object in the image frame, Δ

y₀ denotes a vertical size for the determined size of the motion of the object in the acquired image frame, d denotes the depth indicated by the depth information, θ

_H is ½

of a horizontal field of view of the sensor, θ

_V is ½

of a vertical field of view of the sensor, and C_H and C_V each denote a constant.

10. The apparatus of claim 6, wherein the generated event comprises, as the reaction of the user interface, at least one of display power-on, display power-off, display of menu, movement of a cursor, change of an activated item, selection of an item, an operation corresponding to an item, a display channel change, and sound modification.

11. A method for generating motion information relating to a motion of an object to provide reaction of a user interface to the motion of the object, the method comprising:

calculating a size of the motion of the object using an image frame acquired by capturing the object through a sensor, the image frame divided into a plurality of regions comprising a first region having a first threshold and a second region having a second threshold, different from the first threshold; and

generating the motion information by comparing a threshold corresponding to a region, among the first and second regions, comprising the motion of the object with the calculated size of the motion.

12. The method of claim 11, wherein the first and second thresholds each comprise at least one of a threshold Tx for a horizontal direction in the acquired image frame, a threshold Ty for a vertical direction in the acquired image frame, and a threshold Tz for a direction perpendicular to the acquired image frame.

13. The method of claim 12, wherein at least one of a value of the threshold Tx and a value of the threshold Ty in a center region of the acquired image frame among the plurality of the regions, is less than a value of the threshold Tx and a value of the threshold Ty in an edge region of the acquired image frame.

14. The method of claim 12, wherein a value of the threshold Tz in a center region of the acquired image frame among the plurality of the regions is greater than a value of the threshold Tz in an edge region of the acquired image frame.

15. The method of claim 11, wherein, when the object has a same actual motion size and different calculated motion sizes in the first and second regions, respectively, within a field of view of the sensor, the first and second thresholds have preset values, respectively, to generate a same event in response to the same actual motion of the object in the first and second regions.

16. The method of claim 11, wherein the generating the motion information comprises determining which of the plurality of the regions the object belongs to.

17. The method of claim 11, wherein the generating the motion information comprises:

detecting depth information of the object through the sensor; and

obtaining a size of a compensated motion by compensating the calculated size of the motion of the object using the detected depth information.

18. The method of claim 11, further comprising:

generating an event corresponding to the generated motion information,

wherein the generated event comprises, as the reaction of the user interface, at least one of display power-on, display power-off, display of menu, movement of a cursor, change of an activated item, selection of an item, an operation corresponding to an item, a display channel change, and sound modification.

32. A computer readable recording medium having recorded thereon a program executable by a computer for performing the method of claim 11.

19. An apparatus for generating motion information relating to a motion of an object to provide reaction of a user interface to the motion of the object, the apparatus comprising:

a sensor which obtains an image frame by capturing the object, the obtained image frame divided into a plurality of regions comprising a first region having a first threshold and a second region having a second threshold, different from the first threshold; and

a controller which calculates a size of the motion of the object using the obtained image frame, and generates the motion information by comparing a threshold corresponding to a region, among the first and second regions, comprising the motion of the object with the calculated size of the motion.

20. The apparatus of claim 19, wherein the first and second thresholds each comprise at least one of a threshold Tx for a horizontal direction in the obtained image frame, a threshold Ty for a vertical direction in the obtained image frame, and a threshold Tz for a direction perpendicular to the obtained image frame.

21. The apparatus of claim 20, wherein at least one of a value of the threshold Tx and a value of the threshold Ty in a center region of the obtained image frame among the plurality of the regions, is less than a value of the threshold Tx and a value of the threshold Ty in an edge region of the image frame.

22. The apparatus of claim 20, wherein a value of the threshold Tz in a center region of the obtained image frame among the plurality of the regions is greater than a value of the threshold Tz in an edge region of the obtained image frame.

23. The apparatus of claim 19, wherein, when the object has a same actual motion size and different calculated motion sizes in the first and second regions, respectively, in a field of view of the sensor, the first and second thresholds have preset values, respectively, to generate a same event in response to the same actual motion of the object in the first and second regions.

24. The apparatus of claim 19, wherein the controller comprises a generator which determines which of the plurality of the regions the object belongs to.

25. The apparatus of claim 19, wherein the controller comprises:

a detector which detects depth information of the object through the sensor; and

a generator which obtains a size of a compensated motion by compensating the calculated size of the motion of the object using the detected depth information.

26. The apparatus of claim 19, wherein the controller comprises:

a generator which generates an event corresponding to the generated motion information,

wherein the generated event comprises, as the reaction of the user interface, at least one of display power-on, display power-off, display of menu, movement of a cursor, change of an activated item, selection of an item, an operation corresponding to an item, a display channel change, and sound modification.

27. A method for generating motion information relating to a motion of an object to provide reaction of a user interface to the motion of the object, the method comprising:

detecting depth information of the object; and

generating the motion information by compensating the motion of the object using the detected depth information.

33. A computer readable recording medium having recorded thereon a program executable by a computer for performing the method of claim 27.

28. An apparatus for generating motion information relating to a motion of an object to provide reaction of a user interface to the motion of the object, the apparatus comprising:

a sensor which obtains depth information of the object; and

a controller which generates the motion information by compensating the motion of the object using the detected depth information.

29. An apparatus for generating motion information relating to a motion of an object to provide reaction of a user interface to the motion of the object, the apparatus comprising:

a sensor which obtains an image frame by capturing the object; and

a controller which detects a location of the object using the obtained image frame, and generates motion information corresponding to the motion of the object based on the detected location,

when the object has a same actual motion at a first location and a second location having different depths with respect to the sensor, the controller generates the motion information by compensating the motion of the object in the obtained image frame so as to be equal at the first and second locations.

30. An apparatus for generating motion information relating to a motion of an object to provide reaction of a user interface to the motion of the object, the apparatus comprising:

a sensor which obtains an image frame by capturing the object; and

a controller which detects a location of the object in the obtained image frame, and generates motion information corresponding to the motion of the object using the detected location,

wherein when the object has a same actual motion in first and second locations, the controller generates the motion information by compensating the motion of the object in the obtained image frame to generate a same event in response to the same actual motion of the object at the first location and the second location, respectively, and

wherein the first location and the second location have a same depth with respect to the sensor and are different with respect to at least one of a horizontal distance and a vertical distance from a center of the obtained image frame.