IMAGE DISPLAYING DEVICE AND METHOD, AND IMAGE PROCESSING DEVICE AND METHOD

• US 20100085478A1
• Filed: 02/05/2007
• Published: 04/08/2010
• Est. Priority Date: 09/28/2006
• Status: Abandoned Application

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Ueno, Masafumi, Furukawa, Hiroyuki, Yoshida, Yasuhiro, Yamamoto, Kenichiroh
• Application Number:
  US12/443,400
• Publication Number:
  US 20100085478A1
• Time in Patent Office: Days
• US Class Current: 348/452
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2320/106 Determination of movement vectors or equivalent parameters within the image
• CPC Class Codes: G09G 2340/0435 Change or adaptation of the frame rate of the video stream
• CPC Class Codes: G09G 3/3208 organic, e.g. using organic light-emitting diodes [OLED]
• CPC Class Codes: G09G 3/344 based on particles moving in a fluid or in a gas, e.g. electrophoretic devices electrophoretic devices per se G02F1/167
• CPC Class Codes: G09G 3/3611 Control of matrices with row and column drivers
• CPC Class Codes: H04N 21/440281 by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 7/0135 involving interpolation processes interpolation-based image scaling G06T3/4007; interpolation for video coding H04N19/587, H04N19/59

Abstract

In an image displaying device that includes a frame rate converting (FRC) portion, deterioration in image quality particularly of a telop part is prevented. The FRC portion 100 includes a motion vector detecting portion 101 and an interpolation frame generating portion 102. The motion vector detecting portion 101 includes a frame delaying portion 1 for delaying an input signal by one frame, an initial displacement vector selecting portion 2 for selecting and outputting an initial displacement vector used for vector detection, a motion vector calculating portion 3 for detecting a motion vector using the initial displacement vector, a vector memory 4 for storing a vector detection result, and a telop information detecting portion 5 for detecting an area where one or more telops exist and a moving speed thereof using a vector detection result in a previous frame supplied from the vector memory 4. The detection result from the telop information detecting portion 5 is reflected in processing in the initial displacement vector selecting portion 2 and/or the motion vector calculating portion 3 to improve accuracy of detecting a vector of a telop part.

Claims

1-25. -25. (canceled)

26. An image displaying device having rate converting portion that converts and outputs the number of frames or fields of the input image signal to a display panel by interpolating an image signal which motion compensation processing has been executed between frames or fields of an input image signal, wherein

a detecting portion for detecting area(s) of one or more telops and/or motion vector(s) included in the input image signal is provided and

the motion compensation processing in the rate converting portion is controlled based on the detected area(s) of one or more telops and/or the motion vector(s).

27. The image displaying device as defined in claim 26, wherein

the detecting portion divides a screen into a plurality of areas, obtains an average deviation of an average vector for each area, and detects an area in which a distance between the average vector for each area and an average vector of an entire screen is larger than the threshold which is obtained by multiplying the average deviation by a predetermined coefficient as a telop area.

28. The image displaying device as defined in claim 26, wherein

the detecting portion divides a screen into a plurality of areas, obtains an average deviation of an average vector for each area, detects an area in which a distance between the average vector for each area and an average vector of an entire screen is larger than the threshold which is obtained by multiplying the average deviation by a predetermined coefficient as a telop area,

obtains an average vector of vectors in the detected telop area and detects it as a motion vector of the telop.

29. The image displaying device as defined in claim 26, wherein

different motion compensation processing is performed for the detected telop area and for other areas.

30. The image displaying device as defined in claim 26, wherein

the detected motion vector(s) of the telops is(are) added as candidate vectors for the motion vector(s) used for the motion compensation processing to the detected area(s) of one or more telops.

31. The image displaying device as defined in claim 26, wherein

the motion compensation processing is performed to the detected area(s) of one or more telops by preferentially selecting the detected motion vector(s) of the telops.

32. The image displaying device as defined in claim 26, wherein

the motion compensation processing is performed to the detected area(s) of one or more telops using the detected motion vector(s) of the telops.

33. The image displaying device as defined in claim 26, wherein

the motion compensation processing is performed to areas other than the detected area(s) of one or more telops by preferentially selecting an average vector of the whole screen.

34. The image displaying device as defined in claim 26, wherein

the motion compensation processing is performed to areas other than the detected area(s) of one or more telops by preferentially selecting 0 vector.

35. The image displaying device as defined in claim 26, wherein

filter processing is performed for a border part between the detected area(s) of one or more telops and other areas.

36. The image displaying device as defined in claim 26, wherein

the detected motion vector(s) of the telops is(are) added as candidate vectors for the motion vector(s) used for the motion compensation processing.

37. An image displaying device having rate converting portion that converts and outputs the number of frames or fields of the input image signal to a display panel by interpolating an image signal which motion compensation processing has been executed between frames or fields of an input image signal, wherein

the rate converting portion comprises a motion vector detecting portion that detects a motion vector that shows a size and a direction of motion between input image signals separated by at least one frame or one field or more for each block by dividing the frames or the fields of the input image signal into a plurality of blocks of a predetermined fixed size, and

the motion vector detecting portion has a storage portion that stores a motion vector detected for each block by an amount for at least one frame or one field,

a telop information detecting portion that detects the area(s) of one or more telops and/or motion vector(s) included in the input image signal using a motion vector stored in the storage portion,

an initial displacement vector selecting portion that selects a motion vector having a most appropriate value for motion of a block to be detected as an initial displacement vector of the block to be detected among candidate vector groups read from motion vectors stored in the storage portion using the area(s) of one or more telops and/or motion vector(s) detected by the telop information detecting portion, and

a motion vector calculating portion that obtains and outputs a motion vector of the block to be detected by performing predetermined calculation in which the area(s) of telops and/or motion vector(s) detected by the telop information detecting portion is(are) used and the initial displacement vector selected by the initial displacement vector selecting portion is determined as a starting point and stores it in the storage portion.

38. The image displaying device as defined in claim 37, wherein

the initial displacement vector selecting portion performs different processing for the area(s) of one or more telops detected by the telop information detecting portion and for other areas.

39. The image displaying device as defined in claim 38, wherein

the initial displacement vector selecting portion preferentially selects a candidate vector close to an average vector of an entire screen in an area other than the area(s) of one or more telops detected by the telop information detecting portion.

40. The image displaying device as defined in claim 38, wherein

the initial displacement vector selecting portion preferentially selects a candidate vector close to 0 vector in an area other than the area(s) of one or more telops detected by the telop information detecting portion.

41. The image displaying device as defined in claim 37, wherein

the initial displacement vector selecting portion adds and processes the motion vector(s) of one or more telops detected by the telop information detecting portion to the candidate vector.

42. The image displaying device as defined in claim 41, wherein

the initial displacement vector selecting portion adds and processes the motion vector(s) of one or more telops detected by the telop information detecting portion to the candidate vector for a block that corresponds to the area(s) of one or more telops detected by the telop information detecting portion.

43. The image displaying device as defined in claim 41, wherein

the initial displacement vector selecting portion performs weighting so that the motion vector(s) of one or more telops can be easily selected among the candidate vectors in the area(s) of one or more telops detected by the telop information detecting portion to perform selection processing of an initial displacement vector.

44. The image displaying device as defined in claim 37, wherein

the motion vector calculating portion changes a calculation method so that a vector in the same direction as a direction of the motion vector(s) of one or more telops detected by the telop information detecting portion is obtained for a block that corresponds to the area(s) of one or more telops detected by the telop information detecting portion.

45. An image displaying method having a rate converting step for converting the number of frames or fields of the input image signal by interpolating an image signal which motion compensation processing has been executed between frames or fields of an input image signal, wherein

a detection step for detecting area(s) of one or more telops and/or motion vector(s) included in the input image signal is included and

the motion compensation processing at the rate converting step is controlled based on the detected area(s) of one or more telops and/or the motion vector(s).

46. An image displaying method having a rate converting step for converting the number of frames or fields of the input image signal by interpolating an image signal which motion compensation processing has been executed between frames or fields of an input image signal, wherein

the rate converting step comprises a motion vector detecting step for detecting a motion vector that shows a size and a direction of motion between input image signals separated by at least one frame or more or one field or more for each block by dividing the frames or the fields of the input image signal into a plurality of blocks of a predetermined fixed size, and

the motion vector detecting step comprises a storing step for storing a motion vector detected for each block by an amount of at least for one frame or one field,

a telop information detecting step for detecting the area(s) of one or more telops and/or motion vector(s) included in the input image signal by using the stored motion vector,

an initial displacement vector selecting step for selecting a motion vector having a most appropriate value for motion of a block to be detected as an initial displacement vector of the block to be detected among candidate vector groups read from motion vectors stored at the storing step by using the detected area(s) of one or more telops and/or motion vector(s), and

a motion vector calculating step for obtaining and outputting a motion vector of the block to be detected by performing predetermined calculation in which the detected area(s) of telops and/or motion vector(s) is(are) used and the initial displacement vector selected at the initial displacement vector selecting step is determined as a starting point.

47. An image processing device having rate converting portion that interpolates an image signal which motion compensation processing has been executed between frames or fields of an input image signal to convert and output the number of frames or fields of the input image signal, wherein

a detecting portion that detects area(s) of one or more telops and/or motion vector(s) included in the input image signal is provided and

the motion compensation processing in the rate converting portion is controlled based on the detected area(s) of one or more telops and/or motion vector(s).

48. An image processing device having rate converting portion that converts and outputs the number of frames or fields of the input image signal by interpolating an image signal which motion compensation processing has been executed between frames or fields of an input image signal, wherein

the rate converting portion comprises a motion vector detecting portion that detects a motion vector that shows a size and a direction of motion in input image signals separated by at least one frame or one field or more for each block by dividing the frames or the fields of the input image signal into a plurality of blocks of a predetermined fixed size, and

the motion vector detecting portion comprises a storage portion that stores a motion vector detected for each block by an amount of at least for one frame or one field,

a telop information detecting portion that detects the area(s) of one or more telops and/or motion vector(s) included in the input image signal using a motion vector stored in the storage portion,

an initial displacement vector selecting portion that selects a motion vector having a most appropriate value for motion of a block to be detected as an initial displacement vector of the block to be detected among candidate vector groups read from a motion vector stored in the storage portion using the area(s) of one or more telops and/or motion vector(s) detected by the telop information detecting portion, and

a motion vector calculating portion that obtains and outputs a motion vector of the block to be detected and stores it in the storage portion by performing predetermined calculation in which the area(s) of telops and/or motion vector(s) detected by the telop information detecting portion is (are) used and the initial displacement vector selected by the initial displacement vector selecting portion is determined as a starting point.

49. An image processing method having a rate converting step for converting the number of frames or fields of the input image signal by interpolating an image signal which motion compensation processing has been executed between frames or fields of an input image signal, wherein

a detection step for detecting the area(s) of one or more telops and/or motion vector(s) included in the input image signal is included and

the motion compensation processing at the rate converting step is controlled based on the detected area(s) of one or more telops and/or motion vector(s).

50. An image processing method having a rate converting step for converting the number of frames or fields of the input image signal by interpolating an image signal which motion compensation processing has been executed between frames or fields of an input image signal, wherein

the rate converting step comprises a motion vector detecting step for detecting a motion vector that shows a size and a direction of motion between input image signals separated by at least one frame or more or one field or more for each block by dividing the frames or the fields of the input image signal into a plurality of blocks of a predetermined fixed size, and

the motion vector detecting step comprises a storing step for storing a motion vector detected for each block by an amount of at least for one frame or one field,

a telop information detecting step for detecting the area(s) of one or more telops and/or motion vector(s) included in the input image signal by using the stored motion vector,

an initial displacement vector selecting step for selecting a motion vector having a most appropriate value for motion of a block to be detected as an initial displacement vector of the block to be detected among candidate vector groups read from motion vectors stored at the storing step by using the detected area(s) of one or more telops and/or motion vector(s), and

a motion vector calculating step for obtaining and outputting a motion vector of the block to be detected by performing predetermined calculation in which the detected area(s) of telops and/or motion vector(s) is(are) used and the initial displacement vector selected at the initial displacement vector selecting step is determined as a starting point.