METHOD AND SYSTEM FOR USE OF INTRINSIC IMAGES IN AN AUTOMOTIVE DRIVER-VEHICLE-ASSISTANCE DEVICE

• US 20130342694A1
• Filed: 06/25/2012
• Published: 12/26/2013
• Est. Priority Date: 06/25/2012
• Status: Abandoned Application

• Current Assignee: Tandent Computer Vision LLC
• Original Assignee: Tandent Vision Science, Inc.
• Inventors: Friedhoff, Richard Mark, Maxwell, Bruce Allen, Smith, Casey Arthur
• Application Number:
  US13/532,106
• Publication Number:
  US 20130342694A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: G06V 10/60 relating to illumination properties, e.g. using a reflectance or lighting model
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

In a first exemplary embodiment of the present invention, an automated, computerized method is provided for processing an image. According to a feature of the present invention, the method comprises the steps of arranging a digital camera on a vehicle body, operating the digital camera to provide an image file depicting an image of a scene related to vehicle operation, in a computer memory, generating an intrinsic representation of the image and using the intrinsic representation to analyze the scene.

Claims

1. For use in a vehicle, an automated, computerized method for processing an image, comprising the steps of:

arranging a digital camera on a vehicle body;

operating the digital camera to provide an image file depicting an image of a scene related to vehicle operation, in a computer memory;

generating an intrinsic representation of the image; and

using the intrinsic representation to analyze the scene.

2. The method of claim 1 wherein the intrinsic representation comprises an intrinsic material reflectance image.

3. The method of claim 1 wherein the intrinsic representation comprises an approximate intrinsic estimate representation.

4. The method of claim 3 wherein the approximate intrinsic estimate representation comprises a Tab representation of the image, wherein T is a log color space distance and ab are coordinates in a log chromaticity plane in the log color space.

5. The method of claim 1 wherein the step of using the intrinsic representation to analyze the scene is carried out by using a recognition engine to identify unique features in the scene.

6. The method of claim 5 including the further step of segmenting the image into regions as a function of the unique features identified by the recognition engine.

7. The method of claim 6 wherein the step of segmenting the image into regions is carried out by segmenting the image into a binary designation of the scene.

8. The method of claim 7 wherein the binary designation of the scene includes a designation of one of road marking and not road marking.

9. A device comprising:

a digital camera adapted for mounting on a vehicle to record an image of a scene related to vehicle operation;

a computer system adapted to be coupled to the digital camera; and

the computer system including a memory storing an image file containing the image of the scene;

the computer system being arranged and configured to execute a routine to generate an intrinsic representation of the image, and use the intrinsic representation to analyze the scene.

10. The device of claim 9 wherein the intrinsic representation comprises an intrinsic material reflectance image.

11. The device of claim 9 wherein the intrinsic representation comprises an approximate intrinsic estimate representation.

12. The device of claim 11 wherein the approximate intrinsic estimate representation comprises a Tab representation of the image, wherein T is a log color space distance and ab are coordinates in a log chromaticity plane in the log color space.

13. The device of claim 9 wherein the step of using the intrinsic representation to analyze the scene is carried out by using a recognition engine to identify unique features in the scene.

14. The device of claim 13 including the further step of segmenting the image into regions identified as a function of the unique features identified by the recognition engine.

15. The device of claim 14 wherein the step of segmenting the image into regions is carried out by segmenting the image into a binary designation of the scene.

16. The device of claim 15 wherein the binary designation of the scene includes a designation of one of road marking and not road marking.

17. A computer program product, disposed on a non-transitory computer readable media, the product including computer executable process steps operable to control a computer to:

receive an image file depicting an image of a scene related to vehicle operation, in a computer memory, generate an intrinsic representation of the image and use the intrinsic representation to analyze the scene.

18. The computer program product of claim 17 wherein the intrinsic representation comprises an intrinsic material reflectance image.

19. The computer program product of claim 17 wherein the intrinsic representation comprises an approximate intrinsic estimate representation.

20. The computer program product of claim 19 wherein the approximate intrinsic estimate representation comprises a Tab representation of the image, wherein T is a log color space distance and ab are coordinates in a log chromaticity plane in the log color space.

21. The computer program product of claim 17 wherein the process step to use the intrinsic representation to analyze the scene is carried out by using a recognition engine to identify unique features in the scene.

22. The computer program product of claim 21 including the further process step of segmenting the image into regions identified as a function of the unique features identified by the recognition engine.

23. The computer program product of claim 22 wherein the process step of segmenting the image into regions is carried out by segmenting the image into a binary designation of the scene.

24. The computer program product of claim 23 wherein the binary designation of the scene includes a designation of one of road marking and not road marking.

25. The computer program product of claim 21 wherein the unique features include road markings and road signs.

26. The computer program product of claim 21 wherein the unique features include road conditions.

27. The computer program product of claim 22 wherein the unique features include uniquely identified objects.

28. The computer program product of claim 22 wherein the unique features include road conditions.

29. The computer program product of claim 22 wherein the unique features include object attributes.

30. The computer program product of claim 21 wherein the process step of using a recognition engine to identify unique features in the scene is carried out by using a recognition engine selected from the group consisting of an object recognition engine, a face recognition engine, an optical character recognition engine and combinations thereof.

31. A computer program product, disposed on a non-transitory computer readable media, the product including computer executable process steps operable to control a computer to:

receive an image file depicting an image of a scene related to vehicle driver appearance, in a computer memory, generate an intrinsic representation of the image and use the intrinsic representation to analyze the vehicle driver appearance.

32. The computer program product of claim 31 wherein the process step to use the intrinsic representation to analyze the vehicle driver appearance is carried out to identify the driver.

33. The computer program product of claim 31 wherein the process step to use the intrinsic representation to analyze the vehicle driver appearance is carried out to identify indications of vehicle driver condition.