Method of converting two-dimensional images into three-dimensional images

• US 5,682,437 A
• Filed: 02/12/1996
• Issued: 10/28/1997
• Est. Priority Date: 09/22/1994
• Status: Expired due to Term

• Current Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Inventors: Okada, Seiji, Mori, Yukio, Maenaka, Akihiro, Uchida, Hidekazu, Tanase, Susumu, Ikeda, Takashi, Okino, Toshiyuki, Takahashi, Minoru, Iinuma, Toshiya, Yamashita, Shugo, Murata, Haruhiko
• Primary Examiner(s): JOHNS, ANDREW W
• Application Number:
  US08/600,034
• Time in Patent Office: 624 Days
• Field of Search: 382/100, 382/103, 382/107, 382/154, 382/173, 382/276, 348/25, 348/44, 348/155, 348/169, 348/699
• US Class Current: 382/100
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/264 using the relative movement of objects in two video frames or fields
• CPC Class Codes: H04N 2013/0085 Motion estimation from stereoscopic image signals
• CPC Class Codes: H04N 2013/0092 Image segmentation from stereoscopic image signals
• CPC Class Codes: H04N 2013/0096 Synchronisation or controlling aspects

Abstract

The present invention relates to a method of converting 2D images into 3D images by producing from a 2D image signal a main image signal and a sub-image signal delayed from the main image signal. In the present invention, a temporary field delay from the main image signal to the sub-image signal is found on the basis of data related to the movement in the current field of the main image signal (a first step). A target field delay is then found on the basis of the temporary field delay found in the first step (a second step). A true field delay used in the succeeding field is found on the basis of the target field delay found in the second step and the true field delay used in the current field (a third step).

Claims

1. A method of converting two-dimensional images into three-dimensional images by producing from a two-dimensional image signal a main image signal and a sub-image signal delayed from the main image signal, comprising:

a first step of finding a temporary field delay indicating the number of fields from a field corresponding to the main image signal to a field corresponding to the sub-image signal on the basis of data related to the movement in the current field of the main image signal;

a second step of finding a target field delay on the basis of the temporary field delay found in the first step; and

a third step of finding a true field delay used in the succeeding field on the basis of the target field delay found in the second step and a true field delay used in the current field.

2. The method according to claim 1, wherein said first step comprises the step of,

finding the temporary field delay on the basis of a table previously storing the relationship of a temporary field delay to data related to the movement of an image.

3. The method according to claim 1, wherein said first step comprises the step of,

finding the temporary field delay on the basis of a relational expression for finding a temporary field delay from data related to the movement of an image.

4. The method according to claim 1, wherein said second step comprises the step of,

taking the temporary field delay found in said first step as the target field delay.

5. The method according to claim 1, wherein said second step comprises the step of,

finding the target field delay on the basis of the temporary field delay found in said first step and past hysteresis data.

6. The method according to claim 5, wherein said second step comprises the steps of

finding an average value of temporary field delays in a predetermined number of fields preceding the current field including the temporary field delay found in said first step, and

taking the average value as the target field delay.

7. The method according to claim 5, wherein said second step comprising the steps of,

finding an average value of temporary field delays in a predetermined number of fields preceding the current field including the temporary field delay found in said first step,

finding one or a plurality of average values of temporary field delays in a predetermined number of fields preceding a field which is one or more fields preceding the current field, and

finding the target field delay on the basis of patterns of a combination of the found average values.

8. The method according to claim 5, wherein said second step comprises the steps of,

finding an average value of temporary field delays in a predetermined number of fields preceding the current field,

finding one or a plurality of average values of temporary field delays in a predetermined number of fields preceding a field which is one or more fields preceding the current field, and

finding the target field delay on the basis of the respective average values.

9. The method according to claim 5, wherein said second step comprises the steps of,

finding an average value of temporary field delays in a predetermined number of fields preceding the current field,

finding one or a plurality of average values of temporary field delays in a predetermined number of fields preceding a field which is one or more fields preceding the current field,

selecting an optimum average value in the current field from the average values, and

finding the target field delay on the basis of patterns of a combination of the optimum average value selected in the current field and one or a plurality of optimum average values selected in fields preceding the current field.

10. The method according to claim 1, wherein said third step comprises the steps of,

making the true field delay used in the succeeding field equal to the true field delay used in the current field in a case where the target field delay found in the second step and the true field delay used in the current field coincide with each other, or in a case where the target field delay found in the second step and the true field delay used in the current field do not coincide with each other and the true field delay used in the current field is not continuing for a predetermined number of fields, and

setting the true field delay used in the succeeding field to a value closer to the target field delay by a predetermined value than the true field delay used in the current field in a case where the target field delay found in the second step and the true field delay used in the current field do not coincide with each other and the true field delay used in the current field is continuing for a predetermined number of fields.

11. The method according to claim 1, wherein said third step comprises the step of,

so determining the true field delay used in the succeeding field that the true field delay used in the current field quickly approaches the target field delay in a case where the plus or minus sign of the target field delay found in the second step differs from the plus or minus sign of the true field delay used in the current field, or in a case where the plus or minus sign of the target field delay found in the second step is the same as the plus or minus sign of the true field delay used in the current field and the absolute value of the target field delay is smaller than the absolute value of the true field delay used in the current field, and

so determining the true field delay used in the succeeding field that the true field delay used in the current field slowly approaches the target field delay in a case where the plus or minus sign of the target field delay found in the second step is the same as the plus or minus sign of the true field delay used in the current field and the absolute value of the target field delay is larger than the absolute value of the true field delay used in the current field.

12. The method according to claim 1, wherein

said third step comprises

a fourth step of judging whether or not the target field delay found in the second step and the true field delay used in the current field coincide with each other,

a fifth step for judging whether or not the plus or minus sign of the target field delay found in the second step and the plus or minus sign of the true field delay used in the current field coincide with each other when it is judged in the fourth step that the target field delay found in the second step and the true field delay used in the current field do not coincide with each other,

a sixth step of judging whether or not the absolute value of the target field delay found in the second step is larger than the absolute value of the true field delay used in the current field when it is judged in the fifth step that the plus or minus sign of the target field delay found in the second step and the plus or minus sign of the true field delay used in the current field coincide with each other,

a seventh step of judging whether or not the true field delay used in the current field is continuing for a first predetermined number of fields when it is judged in the sixth step that the absolute value of the target field delay found in the second step is larger than the absolute value of the true field delay used in the current field,

an eighth step of judging whether or not the true field delay used in the current field is continuing for a second predetermined number of fields smaller than the first predetermined number of fields when it is judged in the fifth step that the plus or minus sign of the target field delay found in the second step and the plus or minus sign of the true field delay used in the current field do not coincide with each other,

a ninth step of judging whether or not the true field delay used in the current field is continuing for a third predetermined number of fields smaller than the first predetermined number of fields when it is judged in the sixth step that the absolute value of the target field delay found in the second step is smaller than the absolute value of the true field delay used in the current field,

a tenth step of making the true field delay used in the succeeding field equal to the true field delay used in the current field when it is judged in the fourth step that the target field delay found in the second step and the true field delay used in the current field coincide with each other, when it is judged in the seventh step that the true field delay used in the current field is not continuing for a first predetermined number of fields, when it is judged in the eighth step that the true field delay used in the current field is not continuing for a second predetermined number of fields, or when it is judged in the ninth step that the true field delay used in the current field is not continuing for a third predetermined number of fields, and

an eleventh step of setting the true field delay used in the succeeding field to a value closer to the target field delay by a predetermined value than the true field delay used in the current field when it is judged in the seventh step that the true field delay used in the current field is continuing for a first predetermined number of fields, when it is judged in the eighth step that the true field delay used in the current field is continuing for a second predetermined number of fields, or when it is judged in the ninth step that the true field delay used in the current field is continuing for a third predetermined number of fields.

13. A method of converting two-dimensional images into three-dimensional images by producing from a two-dimensional image signal a main image signal and a sub-image signal delayed from the main image signal and shifting the phase of the main image signal and/or the sub-image signal, comprising the steps of:

finding a field delay from the main image signal to the sub-image signal in the succeeding field on the basis of data related to the movement in the current field of the main image signal; and

so determining the amount and the direction of phase shift of the main image signal and/or sub-image signal that an amount of the change between a field delay in the current field and the field delay in the succeeding field is substantially reduced.

14. A method of converting two-dimensional images into three-dimensional images by producing from a two-dimensional image signal a main image signal and a sub-image signal delayed from the main image signal, comprising the steps of:

previously storing a plurality of types of tables representing the relationship between the speed of the movement of an image and a field delay, and providing inputting means for designating a predetermined table out of the plurality of types of tables,

calculating the speed of the movement of the main image signal for each field,

finding a field delay on the basis of the table designated by the inputting means and the speed of the movement in the current field of the main image signal, and

determining a field delay from the main image signal to the sub-image signal in the succeeding field on the basis of the found field delay.

15. A method of converting two-dimensional images into three-dimensional images by producing from a two-dimensional image signal a main image signal and a sub-image signal delayed from the main image signal and subjecting the main image signal and the sub-image signal to phase shift in the horizontal direction, comprising the steps of:

previously storing a plurality of types of tables representing the relationship between the speed of the movement of an image and a field delay and an amount of phase shift predetermined for each table, and providing single inputting means for designating a predetermined table out of the plurality of types of tables and at the same time, designating an amount of phase shift corresponding thereto;

calculating the speed of the movement of the main image signal for each field;

finding a field delay on the basis of the table designated by the inputting means and the speed of the movement in the current field of the main image signal;

determining a field delay from the main image signal to the sub-image signal in the succeeding field on the basis of the found field delay; and

subjecting the main image signal and the sub-image signal delayed by said determined field delay from the main image signal to phase shift in the succeeding field depending on the amount of phase shift designated by the inputting means.

16. A method of converting two-dimensional images into three-dimensional images by producing from a two-dimensional image signal a main image signal and a sub-image signal delayed from the main image signal, comprising the steps of:

previously producing a relational expression for finding a field delay on the basis of three-dimensional effect adjusting data and the speed of the movement of an image, and providing inputting means for inputting the three-dimensional effect adjusting data;

calculating the speed of the movement of the main image signal for each field;

finding a field delay on the basis of the adjusting data inputted by the inputting means, the speed of the movement in the current field of the main image signal, and the relational expression previously produced; and

determining a field delay from the main image signal to the sub-image signal in the succeeding field on the basis of the found field delay.

17. A method of converting two-dimensional images into three-dimensional images by producing from a two-dimensional image signal a main image signal and a sub-image signal delayed from the main image signal, comprising the steps of:

previously storing a table representing the relationship between the speed of the movement of an image and a field delay, and providing inputting means for inputting field delay scale factor data;

calculating the speed of the movement of the main image signal for each field;

finding a field delay on the basis of the speed of the movement in the current field of the main image signal and the table;

multiplying the found field delay by the field delay scale factor data inputted by the inputting means; and

determining a field delay from the main image signal to the sub-image signal in the succeeding field on the basis of a value obtained by the multiplication.