Motion-based image segmentor

• US 20050281461A1
• Filed: 06/16/2004
• Published: 12/22/2005
• Est. Priority Date: 06/16/2004
• Status: Abandoned Application

• Current Assignee: Eaton Corp. (Wisconsin) (Eaton Corporation PLC.)
• Original Assignee: Eaton Corp. (Wisconsin) (Eaton Corporation PLC.)
• Inventors: Farmer, Michael, Bapna, Shweta
• Application Number:
  US10/870,830
• Publication Number:
  US 20050281461A1
• Time in Patent Office: Days
• US Class Current: 382/171
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands

Abstract

The present invention relates in general to systems and methods for using motion-based information to segment an image. In particular, the present invention relates to using a joint histogram to isolate a motion-based information of a moving person or object from an “ambient image” of the area surrounding and including the person or object in motion. An exemplary method or system for segmenting an image may include the steps of: generating a joint histogram of a first image and a second image; using the joint histogram to identify motionless information representative of a lack of motion between the first image and the second image; and removing the motionless information from the second image.

Claims

1. A method for segmenting an image, comprising:

generating a joint histogram of a first image and a second image;

using said joint histogram to identify motionless information representative of a lack of motion between said first image and said second image; and

removing said motionless information from said second image.

2. The method of claim 1, wherein said removing motionless information comprises:

identifying pixels of said second image that are associated with said motionless information; and

clearing pixel values of said pixels.

3. The method of claim 2, wherein said identifying includes:

detecting a line of unity slop and intercept zero in said joint histogram, said line being representative of said motionless information; and

associating said line with corresponding pixel addresses of said second image.

4. The method of claim 2, wherein said clearing pixel values comprises zeroing out a value of each of said pixels.

5. The method of claim 1, wherein said generating further comprises incrementing said joint histogram at locations identified by pixel values of spatially corresponding pixels of said first image and said second image.

6. The method of claim 1, wherein said generating further comprises associating histogram cells with pixels of said second image.

7. The method of claim 1, further comprising:

using said joint histogram to identify illumination changes between said first image and said second image; and

removing said illumination changes from said second image.

8. The method of claim 7, wherein said removing illumination changes comprises:

identifying pixels of said second image that are associated with said illumination changes; and

clearing pixel values of said pixels.

9. The method of claim 8, wherein said identifying includes:

detecting distinct lines in said joint histogram, said distinct lines being representative of said illumination effects; and

determining pixel addresses in said second image, wherein said pixel addresses correspond with said distinct lines.

10. The method of claim 8, wherein said clearing pixel values comprises zeroing out a value of each of said pixels.

11. An image segmentation system for segmenting an image acquired with a sensor, comprising:

a histogram module providing for generating a joint histogram of a first image and a second image, wherein said joint histogram indicates motionless information representative of a lack of motion between said first image and said second image; and

a removal module providing for removing said motionless information indicated by said joint histogram from said second image.

12. The system of claim 11, wherein said motionless information is indicated by said joint histogram as a line of unity slope and intercept zero.

13. The system of claim 11, wherein said motionless information is indicated by said joint histogram as locations within approximately a predetermined distance of a line of unity slope and intercept zero.

14. The system of claim 11, wherein said motionless information represents congruent pixel values shared by spatially corresponding pixels of said first image and said second image.

15. The system of claim 11, wherein said histogram module provides for generating said joint histogram by incrementing said joint histogram at locations identified by pixel values of spatially corresponding pixels of said first image and said second image.

16. The system of claim 11, wherein said joint histogram is represented by a number of histogram cells, each said histogram cell being configured to indicate an associated pixel address of said second image.

17. The system of claim 16, wherein said removal module provides for removing said motionless information from said second image by:

identifying a subset of said histogram cells that are associated with said motionless information;

determining pixels of said second image that are associated with said histogram cells; and

clearing pixel values of said pixels.

18. The system of claim 17, wherein said removal module provides for clearing pixel values by zeroing out a value of each said pixel.

19. The system of claim 11, further comprising a second removal module providing for removing illumination effects indicated by said joint histogram from said second image.

20. The system of claim 19, wherein said second removal module provides for removing said illumination effects by:

detecting distinct lines in said joint histogram;

determining pixels of said second image that are associated with said distinct lines; and

clearing pixel values of said pixels.

21. The system of claim 20, wherein said second removal module zeroes out a value of each said pixel.

22. An image segmentation system for a vehicle safety restraint deployment application, comprising:

a sensor configured to acquire a plurality of images representative of an image source area, wherein said plurality of images includes a current image and a previous image;

a computer providing for;

generating a joint histogram of said current image and said previous image, wherein said joint histogram indicates motionless information representative of a lack of motion between said current image and said previous image;

removing said motionless information indicated by said joint histogram from said current image to produce a segmented image;

providing said segmented image to the safety restraint deployment system.

23. The system of claim 22, wherein said motionless information is indicated by said joint histogram as a line of unity slope and intercept zero.

24. The system of claim 22, wherein said motionless information is indicated by said joint histogram as locations within approximately a predetermined distance of a line of unity slope and intercept zero.

25. The system of claim 22, wherein said motionless information represents congruent pixel values shared by spatially corresponding pixels of said current image and said previous image.

26. The system of claim 22, wherein said computer provides for generating said joint histogram by incrementing said joint histogram at locations identified by pixel values of spatially corresponding pixels of said current image and said previous image.

27. The system of claim 22, wherein said joint histogram is represented by a number of histogram cells, each said histogram cell being configured to indicate an associated pixel address of said current image.

28. The system of claim 27, wherein said computer provides for removing said motionless information from said current image by:

identifying a subset of said histogram cells that are associated with said motionless information;

determining pixels of said current image that are associated with said histogram cells; and

clearing pixel values of said pixels.

29. The system of claim 28, wherein said computer provides for clearing pixel values by zeroing out a value of each said pixel.

30. The system of claim 22, wherein said computer further provides for removing illumination effects indicated by said joint histogram from said current image.

31. The system of claim 30, wherein said computer provides for removing said illumination effects by:

detecting distinct lines in said joint histogram;

determining pixels of said current image that are associated with said distinct lines; and

clearing pixel values of said pixels.

32. The system of claim 31, wherein said computer provides for clearing pixel values by zeroing out a value of each said pixel.

33. The system of claim 22, wherein said computer further provides for by removing regions representative of non-occupant motion from said current image.

34. The system of claim 22, wherein said computer system further provides for defining a region of said current image by fitting an elliptical shape to said region.

35. The system of claim 34, wherein said region represents an upper portion of a vehicle occupant.

36. The system of claim 22, wherein said segmented image represents a characteristic of a vehicle occupant.

37. The system of claim 22, wherein said sensor comprises a video camera for sequentially capturing said plurality of images.