Method of controlling stereo convergence and stereo image processor using the same

• US 10,063,833 B2
• Filed: 07/30/2014
• Issued: 08/28/2018
• Est. Priority Date: 08/30/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Irina
• Primary Examiner(s): Vo, Tung
• Assistant Examiner(s): Cattungal, Rowina
• Application Number:
  US14/446,817
• Publication Number:
  US 20150062297A1
• Time in Patent Office: 1,490 Days
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 2213/002 Eyestrain reduction by processing stereoscopic signals or controlling stereoscopic devices

Abstract

A method of controlling a stereo convergence and an image processor using the method are provided. The method includes: detecting objects from a stereo image; grouping the detected objects into at least one or more objects according to setup specification information; and moving at least one of left and right eye images of a stereo image of the grouping or a setup area including the grouping in a horizontal or vertical direction or in the horizontal and vertical directions.

Claims

1. A method of controlling a stereo convergence, the method comprising:

storing a setup specification information according to preferences of a user, the setup specification information including a plurality of distance ranges;

detecting a plurality of objects from a stereo image comprising a left eye image and a right eye image;

grouping the plurality of objects into a plurality of object groups according to the setup specification information, each of the plurality of object groups corresponding to a different one of the plurality of distance ranges;

selecting one of the plurality of object groups as a selected object group based on the plurality of distance ranges indicated by the setup specification information; and

moving at least one of the left eye image and the right eye image of the stereo image to adjust convergence of the selected object group or to adjust convergence of a setup area comprising the selected object group in a horizontal direction or a vertical direction, or in both the horizontal direction and the vertical direction,

wherein the plurality of objects are grouped based on distances between an imaging surface of a camera and the plurality of objects.

2. The method of claim 1, further comprising:

correcting a distorted image after moving the at least one of the left eye image and the right eye image.

3. The method of claim 1, wherein the plurality of objects that are detected are included in common in the left eye image and the right eye image of the stereo image.

4. The method of claim 1, wherein the distances between the imaging surface of the camera and the plurality of objects are calculated based on disparity vectors (DVs) of feature points (FPs) of the plurality of objects.

5. The method of claim 1, wherein the setup area comprises grouping of detected objects corresponding to at least one of a particular distance, a particular character, and a particular background, the at least one of the particular distance, the particular character, and the particular background being selected through a user interface.

6. The method of claim 1, wherein at least one of the left eye image and the right eye image of the stereo image is moved in the horizontal direction or the vertical direction, or in both the horizontal direction and the vertical direction, based on a distribution of disparity vectors (DVs) of the selected object group or the setup area comprising the selected object group.

7. The method of claim 1, wherein the moving of the stereo image comprises:

determining an area of interest comprising the selected object group;

extracting feature points (FPs) from the area of interest;

calculating disparity vectors (DVs) by matching portions of the left eye image and the right eye image corresponding to the FPs; and

moving the at least one of the left eye image and the right eye image of the stereo image in the horizontal direction or the vertical direction, or in both the horizontal direction and the vertical direction, according to the distribution of the DVs.

8. The method of claim 1, where the moving of the stereo image comprises:

generating disparity vectors (DVs) of the selected object group or the setup area comprising the selected object group;

determining a convergence adjustment value based on the DVs; and

moving the left eye image in the horizontal direction or the vertical direction, or in both the horizontal direction and the vertical direction, and moving the right eye image in a direction opposite to a movement direction of the left eye image, based on the convergence adjustment value.

9. The method of claim 8, wherein the determining of the convergence adjustment value comprises:

calculating a histogram illustrating a disparity vector (DV) and frequency by using the DVs that are generated; and

calculating the convergence adjustment value for matching a distribution of the DVs of the histogram with an initially set target distribution.

10. A system on chip comprising:

a memory which stores setup specification information according to preferences of a user and image data, the setup specification information including a plurality of distance ranges;

an object detector which detects a plurality of objects from a stereo image comprising a left eye image and a right eye image;

an object classifier which groups the plurality of objects that are detected from the stereo image into a plurality of object groups according to the setup specification information, each of the plurality of object groups corresponding to a different one of the plurality of distance ranges;

a convergence adjustment area determiner that selects one or more of the plurality of object groups from among the plurality of object groups as selected one or more object groups based on the plurality of distance ranges indicated by the setup specification information; and

a convergence adjuster which moves at least one of the left eye image and the right eye image of the stereo image in a horizontal direction or a vertical direction, or in both the horizontal direction and the vertical direction, to adjust a convergence of at least one object in the selected one or more object groups,

wherein the object classifier classifies the plurality of objects into the plurality of object groups based on distances between an imaging surface of a camera and the plurality of objects.

11. The system on chip of claim 10, wherein the convergence adjustment area determiner selects at least one object group from the plurality of object groups, based on an initially set threshold distance, and detects the selected one or more object groups or a setup area comprising the selected one or more object groups.

12. The system on chip of claim 10, wherein the convergence adjuster comprises:

a feature extractor which extracts feature points (FPs) from the left eye image or the right eye image of the stereo image;

a disparity vector (DV) calculator which calculates disparity vectors (DVs) by matching portions of the left eye image and the right eye image corresponding to the FPs; and

a convergence controller which moves the at least one of the left eye image and the right eye image of the stereo image in the horizontal direction or the vertical direction, or in both the horizontal direction and the vertical direction, based on the DVs.

13. The system on chip of claim 12, wherein the convergence controller comprises:

a histogram generator which calculates a histogram illustrating a disparity vector (DV) and frequency by using the disparity vectors (DVs);

a convergence adjustment value calculator which calculates an image movement value in a horizontal direction or a vertical direction, or in both the horizontal direction and the vertical direction, of the left eye image or the right eye image for matching a distribution of DVs of the histogram with a target distribution; and

an image mover which moves the at least one of the left eye image and the right eye image in the horizontal direction or the vertical direction, or in both the horizontal direction and the vertical direction, according to the image movement value.

14. The system on chip of claim 10, wherein the convergence adjuster moves the at least one of the left eye image and the right eye image, based on the DVs.

15. A method of controlling a stereo convergence, the method comprising:

storing specification information according to preferences of a user, the specification information including a plurality of distance ranges;

detecting one or more first objects in a left eye image of a stereo image, and one or more second objects in a right eye image of the stereo image;

grouping the one or more first objects and the one or more second objects into a plurality of object groups according to the specification information and characteristics of the one or more first objects and the one or more second objects, each of the plurality of object groups comprising a first object from the left eye image and a second object from the right eye image, and each of the plurality of object groups corresponding to a different one of the plurality of distance ranges;

selecting one of the one or more object groups from among the plurality of object groups as a selected object group based on the plurality of distance ranges indicated by the specification information;

determining feature points (FPs) of objects in the selected object group;

determining disparity vectors (DVs) with respect to the FPs; and

moving the left eye image with respect to the right eye image in order to adjust the DVs of at least one object in the selected object group,

wherein the one or more first objects and the one or more second objects that are detected are grouped based on distances between an imaging surface of a camera and the one or more first objects and the one or more second objects.

16. The method of claim 15, wherein the left eye image is moved with respect to the right eye image to adjust an average value of the DVs to a target disparity value.

17. The method of claim 15, wherein the specification information includes the plurality of distance ranges, a particular character, and/or a particular background.