Non-photorealistic camera

• US 7,295,720 B2
• Filed: 03/19/2003
• Issued: 11/13/2007
• Est. Priority Date: 03/19/2003
• Status: Active Grant

• Current Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Electric Research Laboratories (Mitsubishi Electric Corporation)
• Inventors: Raskar, Ramesh
• Primary Examiner(s): Bella; Matthew C.
• Assistant Examiner(s): Hung; Yubin
• Application Number:
  US10/392,061
• Publication Number:
  US 20040183940A1
• Time in Patent Office: 1,700 Days
• Field of Search: 382/190, 382/199, 382/224, 382/254, 382/256, 382/312, 382/284, 250/559.36, 345/582, 345/419, 348/207.1, 348/207.2, 348/239, 348/371, 348/578, 348/584, 356/613
• US Class Current: 382/312
• CPC Class Codes: G06T 15/02 Non-photorealistic rendering
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/2625 for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect sequence generated by event triggered capturing H04N7/188

Abstract

A camera has a single lens and multiple flash units distributed around the lens. A set of images is acquired of a scene with different controlled lighting applied by the flash units, one at the time. The images are stored in a memory, and then combined to produce a single stylized image of the scene from the acquired images.

Claims

1. An apparatus for generating a stylized image, comprising:

a single lens;

a plurality of flash units distributed around a center of projection of the lens;

means for acquiring a set of images of a scene, each image having a different controlled lighting applied by the plurality of flash units, and where a maximum image of the set of images approximates an image of the scene with a point light source at a center of projection of the lens;

a memory storing the set of acquired images; and

means for combining the set of images, using the maximun image, into a single stylized image of the scene.

2. The apparatus of claim 1 wherein there are four flash units arranged in top-bottom and left-right pairs.

3. The apparatus of claim 1 wherein the plurality of flash units are mounted on a front surface of the apparatus substantially close to the center of projection of the lens.

4. The apparatus of claim 1 wherein one image is acquired for each flash unit, and another image is acquired with ambient light.

5. The apparatus of claim 1 wherein the stylized image is stored in the memory.

6. The apparatus of claim 1 further comprising:

a port for down-loading the stylized image to an external processor for viewing.

7. The apparatus of claim 1 further comprising:

means for classifying each pixel in each image as being either a silhouette edge pixel, a texture edge pixel, or a featureless pixel.

8. The apparatus of claim 7 wherein silhouette edge pixels are located at a depth discontinuity, texture edge pixels are identified by changes in reflectance and material discontinuities in the scene, and featureless pixels correspond to portions in the scene with near constant reflectance and low curvature.

9. The apparatus of claim 7 wherein the silhouette edge pixels correspond to cast shadows defined in an image space.