System and method for detecting visual occlusion based on motion vector density

• US 7,990,476 B2
• Filed: 09/19/2007
• Issued: 08/02/2011
• Est. Priority Date: 09/19/2007
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Sangkeun
• Primary Examiner(s): PERUNGAVOOR, SATHYANARAYA V
• Application Number:
  US11/858,014
• Publication Number:
  US 20090074311A1
• Time in Patent Office: 1,413 Days
• Field of Search: 348/699
• US Class Current: 348/699
• CPC Class Codes: G06T 7/223 using block-matching
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51
• CPC Class Codes: H04N 7/014 involving the use of motion vectors motion estimation and compensation in video coding H04N19/51

Abstract

A method of processing image data, comprising providing image data configured to display a first frame comprising a plurality of blocks, each block having a motion vector indicative of a change of location of the block between the first frame and a successive second frame and determining a change in state of occlusion of a first block of the plurality of blocks by reference to motion vectors having a destination in the first block.

Claims

1. A method of processing image data comprising:

providing image data defining a first frame comprising a plurality of blocks, each block having a motion vector indicative of a destination location in a second frame;

determining the number (N) of motion vectors indicative of a destination location within a distance of a target location in the second frame, the distance greater than zero; and

determining a change in state of occlusion of the target location based on N.

2. The method of claim 1, wherein determining the change in state of occlusion includes comparing N with a predetermined value.

3. The method of claim 1, further comprising determining the number (M) of possible destination locations within the distance of the target location in the second frame, wherein the determining the change in state of occlusion includes comparing N and M.

4. The method of claim 3, wherein comparing N and M comprises determining if N is at least 20% more than the M.

5. The method of claim 3, wherein comparing N and M comprises determining if N is at least 30% more than the number of blocks.

6. The method of claim 3, wherein comparing N and M comprises determining if the N is less than M.

7. The method of claim 3, wherein comparing N and M comprises determining if N is at most 20% less than M.

8. The method of claim 3, wherein comparing N and M comprises determining if N is at most 30% less than the M.

9. The method of claim 1, wherein the first frame is after a second, preceding frame of image data.

10. The method of claim 1, wherein the first frame occurs before the second frame.

11. The method of claim 1, additionally comprising the step of providing the change in state of occlusion of the target location to a processing component.

12. The method of claim 1, wherein determining the change in state of occlusion of the target location includes determining when N is greater than a predetermined value, the predetermined value is greater than one.

13. The method of claim 1, wherein determining the change in state of occlusion of the target location includes determining whether the motion vectors are angled towards each other.

14. The method of claim 1, further comprising:

creating a geometric window around the target location; and

wherein;

determining the change in state of occlusion of the target location includes determining whether the motion vectors are within the geometric window.

15. An image processing system comprising:

a motion estimation component configured to receive image information, and determine motion vector information based on the image information;

a state detection component configured to receive the motion vector information and determine state information based on the motion vector information including motion vector density information; and

a frame rate conversion component adapted to receive the image information and the state information, and to alter the image information based on the state information.

16. The image processing system of claim 15, wherein the image information is video.

17. The image processing system of claim 15, wherein the image information comprises image data defining a first frame comprising a plurality of blocks, the motion vector information comprises data defining a plurality of motion vectors, each motion vector associated with a block and indicative of a destination location in a second frame, and the determining of state information comprises determining the number of motion vectors indicative of a destination location with a distance of a target location in the second frame and comparing the number to a predetermined value.

18. The image processing system of claim 17, wherein the predetermined value is at least 18% more than the number of possible destination locations within the distance of the target location in the second frame.

19. The image processing system of claim 17, wherein the predetermined value is at least 30% more than the number of possible destination locations within the distance of the target location in the second frame.

20. The image processing system of claim 17, wherein the predetermined value is at most 18% less than the number of possible destination locations within the distance of the target location in the second frame.

21. The image processing system of claim 17, wherein the predetermined value is at most 30% less than the number of possible destination locations within the distance of the target location in the second frame.

22. An image processing system comprising:

means for providing image data defining a first frame comprising a plurality of blocks, each block having a motion vector indicative of a destination location in a second frame;

means for determining the number (N) of motion vectors indicative of a destination location within a distance of a target location in the second frame, the distance greater than zero; and

means for determining a change in state of occlusion of the target location based on N.

23. One or more processor-readable storage devices having processor-readable code embodied on the processor-readable storage device, the processor-readable code for programming one or more processors to perform a method for obtaining a transmit beamforming vector for transmission of high definition video data over a wireless medium, the method comprising:

providing image data defining a first frame comprising a plurality of blocks, each block having a motion vector indicative of a destination location in a second frame;

determining the number (N) of motion vectors indicative of a destination location within a distance of a target location in the second frame, the distance greater than zero; and

determining a change in state of occlusion of the target location based on N.