CAMERA SYSTEM AND METHOD FOR REMOTELY CONTROLLING COMPOSITIONS OF SELF-PORTRAIT PICTURES USING HAND GESTURES

• US 20150201124A1
• Filed: 01/15/2014
• Published: 07/16/2015
• Est. Priority Date: 01/15/2014
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Litvak, Shai, Shimshi, Or
• Application Number:
  US14/155,940
• Publication Number:
  US 20150201124A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body

Abstract

A camera system for taking a self-portrait picture includes a buffer memory and an image processor unit. The buffer memory stores a first image and a second image. Both images contain a human figure. In the first figure the human figure is standing in a command pose, and in the second image in a free pose. The image processor unit detects a human figure in the first image, determines whether the pose of the human figure is a command pose, detects a specific composition gesture pattern corresponding to pose of the human figure in the first image, determines the intended composition of the self-portrait picture using the detected composition gesture pattern, process the second image according to the intended composition, and stores the processed image.

Claims

1. A camera system for taking a self-portrait picture, comprising:

a buffer memory configured to store a first image and a second image; and

an image processor unit configured to;

detect a human object from the first image,

determine whether the human object is a command object,

detect a composition gesture pattern of the command object from the first image,

determine a composition of the self-portrait picture using the detected composition gesture pattern, and

generate the second image having a posing object, wherein the posing object is a same human object as the command object and has no composition gesture pattern.

2. The camera system of claim 1, wherein the image processor unit is further configured to select one of a plurality of composition templates to determine the composition, wherein each composition template includes information of a relative size and location of the posing object in the second image.

3. The camera system of claim 2, wherein the image processor unit is further configured to calculate a relative size and location of the command object in the first image.

4. The camera system of claim 3, wherein the image processor unit is further configured to calculate values of camera parameters using the relative size and location of the command object and a relative size and location of the posing object defined in the selected composition template, the camera parameters including parameters for pan control, zoom control, or tilt control.

5. The camera system of claim 4, wherein the camera parameters further includes parameters for exposure control or focus control.

6. The camera system of claim 2, wherein the second image has the selected composition template.

7. The camera system of claim 1, further comprising a non-volatile memory configured to store the second image in a compressed data format.

8. The camera system of claim 3, wherein the image processor unit is further configured to perform an image manipulation operation on the second image thereby generating a third image having the selected composition template.

9. The camera system of claim 8, wherein the image manipulation operation includes a cropping operation or a digital zooming operation.

10. The camera system of claim 9, wherein the cropping operation selects part of the second image, and a dimension and location of the part of the second image is determined using the relative size and location of the command object and a relative size and location of the posing object defined in the selected composition template.

11. The camera system of claim 10, further comprising a non-volatile memory configured to store the third image in a compressed data format.

12. The camera system of claim 1, wherein the command object has an activation gesture pattern of a predefined hand pattern in the first image, wherein the image processor unit is further configured to detect the predefined pattern from the first image.

13. The camera system of claim 12, wherein the predefined pattern includes two fist patterns of the command object.

14. The camera system of claim 1, wherein the composition gesture pattern includes a combination of relative positions of two fist patterns of the command object with respect to a face pattern of the command object or a body pattern of the command object.

15. The camera system of claim 14, wherein the relative positions of the two fist patterns includes a fully-stretched position, a half-stretched position, a fist-down position, a fist-up position, or a partially-extended-fist-up position.

16. The camera system of claim 1, wherein the image processor unit is further configured to generate a ready signal when the composition gesture pattern is detected.

17. The camera system of claim 16, wherein the ready signal includes a sound signal or a light signal.

18. The camera system of claim 16, wherein the image processor unit is further configured to generate a shooting command a predetermined time after the ready signal is generated.

19. The camera system of claim 18, wherein the second image is stored in the buffer memory after the shooting command is generated.

20. The camera system of claim 12, wherein a relative size of the command object is increased to include objects having no composition gesture patterns.

21. The camera system of claim 12, wherein when at least two human objects collaboratively have the activation gesture pattern, the command object includes the at least two human objects.

22. A camera system for taking a self-portrait picture, comprising:

a buffer memory configured to store a first image and a second image; and

an image processor unit configured to;

detect a human object from the first image,

determine whether the human object is a command object,

calculate a first horizontal distance of one hand pattern of the command object from a corresponding body or face pattern,

calculate a second horizontal distance of another hand pattern of the command object from the corresponding body or face pattern,

calculate values of camera parameters using the first and the second horizontal distance, and

generate the second image having a posing object,

wherein the posing object is a same human object as the command object.

23. The camera system of claim 22, wherein a relative horizontal location of the posing object in the second image is determined using difference of the first horizontal distance and the second horizontal distance.

24. The camera system of claim 22, wherein a relative size of the posing object in the second image is determined using sum of the first horizontal distance and the second horizontal distance.

25. A method of controlling a camera system for taking a self-portrait picture, the method comprising:

receiving first scene information using a first photographic frame;

storing a first image, corresponding to the first scene information, in a buffer memory;

detecting a human object from the first image;

determining whether the human object is a command object, the command object having an activation gesture pattern of a predefined hand pattern;

when the command object is detected, detecting a composition gesture pattern from the command object, wherein the composition gesture pattern is one of a plurality of predefined hand gesture patterns; and

selecting one of a plurality of composition templates corresponding to the detected composition gesture pattern, wherein each composition template corresponds to each predefined hand gesture pattern.

26. The method of claim 25, further comprising:

generating a ready signal after the selecting of the one of the plurality of the composition templates.

27. The method of claim 25, wherein the detecting of the human object comprises:

dividing the first image into a foreground image and a background image; and

detecting the human object from the foreground image.

28. The method of claim 27, further comprising:

detecting a face pattern of the human object;

detecting a body pattern of the human object;

detecting a hand pattern of the human object; and

determining whether the hand pattern matches the predefined hand pattern, wherein when the hand pattern matches the predefined hand pattern, the human object is treated as command object.

29. The method of claim 28, wherein the detecting of the composition gesture pattern further comprises:

calculating a relative position of the hand pattern with respect to the face pattern or the body pattern.

30. The method of claim 29, wherein the relative position of the hand pattern includes a fully-stretched position, a half-stretched position, a fist-down position, a fist-up position, or a partially-extended-fist-up position.

31. The method of claim 25, further comprising calculating a relative location and size of the command object in the first image.

32. The method of claim 31, further comprising:

calculating values of camera parameters using the relative size and location of the command object and a relative size and location of the posing object that is defined in the selected composition template;

shifting the first photographic frame to a second photographic frame based on the calculated camera parameter values;

receiving second scene information using the second photographic frame; and

storing a second image having a posing image, wherein the posing image is a same human object as the command object.

33. The method of claim 26, wherein when at least one of the calculated camera parameter values is out of an allowable range, an out-of-range signal is generated.

34. The method of claim 31, further comprising:

receiving second scene information using the first photographic frame;

storing a second image having a posing object, wherein the posing object is a same human object as the command object.

calculating a cropping region using the relative size and location of the command object and a relative size and location of the posing object that is defined in the selected composition template;

performing a cropping operation, using the cropping region, on the second image to generate a third image.

35. The method of claim 34, further comprising a digital zooming operation on the cropped region of the second image to generate the third image.

36. The method of claim 34, wherein when the cropping region includes a region outside the command image, an out-of-bounds signal is generated.