Digital camera and method providing selective removal and addition of an imaged object

• US 20050129324A1
• Filed: 12/02/2003
• Published: 06/16/2005
• Est. Priority Date: 12/02/2003
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Lemke, Alan P.
• Application Number:
  US10/727,173
• Publication Number:
  US 20050129324A1
• Time in Patent Office: Days
• US Class Current: 382/254
• CPC Class Codes: G06V 10/26 Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability

Abstract

A digital camera and a method produce a desired image from an image captured with the digital camera. The digital camera includes a computer program that, when executed by a controller of the digital camera, implements processing a set of captured images to produce the desired image within the digital camera. The desired image includes selected image portions of the captured images from the set. The desired image is stored in a memory of the digital camera. The method includes processing a set of captured images to produce the desired image with the digital camera. Processing the set includes one or both of image object removal from and addition to an image scene.

Claims

1. A method of removing an imaged object from an image using a digital camera comprising:

processing within the digital camera a set of one or more captured images, a captured image of the set having an imaged object that is undesired in the captured image, wherein processing produces a desired image absent the undesired imaged object.

2. The method of removing of claim 1, wherein processing comprises removing the undesired imaged object from the captured image.

3. The method of removing of claim 2, wherein removing comprises removing a portion of the captured image, the image portion containing the undesired imaged object.

4. The method of removing of claim 3, wherein processing further comprises replacing the removed portion with a portion of a background scene, the background scene portion being from another captured image of the set, the background scene portion being obscured by the undesired imaged object in the first captured image and being unobscured in the other captured image.

5. The method of removing of claim 1, wherein processing comprises replacing the undesired imaged object in the captured image with a portion of a background scene, the background scene being present in one or more of the captured images.

6. The method of removing of claim 5, wherein the portion of the background scene is from another captured image of the set, the background scene portion being obscured by the undesired imaged object in the first captured image and being unobscured in the other captured image of the set.

7. The method of removing of claim 1, wherein the undesired imaged object is a flawed portion of the captured image, and wherein processing comprises removing the flawed portion from the captured image.

8. The method of removing of claim 7, wherein processing further comprises replacing the removed flawed portion with an unflawed portion from another captured image of the set.

9. The method of removing of claim 1, further comprising:

capturing one or more images with the digital camera; and

storing the desired image in a memory of the digital camera.

10. The method of removing of claim 9, wherein capturing comprises using a constant camera orientation for capturing the images.

11. The method of removing of claim 1, wherein processing comprises comparing the captured images of the set to detect a change between respective captured images of the set, the detected change representing the undesired imaged object obscuring a different image portion of at least one other captured image from the set, such that the undesired imaged object is replaced during comparing by a corresponding image portion of a captured image of the set, the corresponding image portion having no detected change.

12. A method of adding an imaged object to an image using a digital camera comprising:

processing within the digital camera captured images captured to produce a desired image, at least a first captured image of the plurality including a scene without a desired imaged object, at least a second captured image including the desired imaged object, the desired image comprising the imaged object added to the scene.

13. The method of adding of claim 12, further comprising:

capturing a plurality of images with the digital camera; and

storing the desired image in a memory of the digital camera.

14. The method of adding of claim 12, wherein processing comprises selectively combining within the digital camera the first captured image and an image portion of the second captured image, the image portion containing the imaged object.

15. The method of adding of claim 12, wherein processing comprises:

identifying the imaged object to be added to the scene;

extracting the imaged object from the second captured image; and

applying the imaged object to the scene in the first captured image.

16. The method of adding of claim 15, wherein extracting and applying respectively comprise selectively cutting a portion of the second captured image that includes the imaged object, and pasting the image portion in a location in the first captured image over or under the scene, such that a corresponding portion of the scene from the location is replaced.

17. A digital camera that produces a desired image from a captured image, the digital camera comprising:

a computer program stored in a memory of the camera and executed by a controller of the camera, the computer program comprising instructions that, when executed by the controller, implement processing one or more captured images to produce a desired image within the digital camera, the desired image comprising selected image portions of the captured images, the desired image being stored in the digital camera.

18. The digital camera of claim 17, wherein the instructions that implement processing comprise instructions that implement adding to a first captured image an imaged object contained in a selected image portion from a second captured image.

19. The digital camera of claim 17, wherein the instructions that implement processing comprise instructions that implement removing from a captured image an imaged object that is undesirable for the desired image.

20. The digital camera of claim 19, wherein the instructions that implement processing further comprise instructions that implement replacing the imaged object in the captured image with a selected image portion from another captured image.

21. The digital camera of claim 17, wherein the instructions that implement processing comprise instructions that implement one or both of adding to a first captured image an imaged object contained in a selected image portion from a second captured image and removing from the first captured image an undesired imaged object contained in another selected image portion.

22. The digital camera of claim 17, wherein the computer program further comprises instructions that implement capturing a plurality of images with the digital camera, and instructions that implement storing the desired image.

23. The digital camera of claim 17, further comprising:

an image capture subsystem;

a user interface;

the memory; and

the controller that interfaces to the image capture subsystem, the user interface and the memory.

24. A digital camera comprising:

means for storing an image;

means for controlling the digital camera; and

means for producing a desired image within the digital camera from a set of images captured by the digital camera, the means for controlling executing the means for producing, the desired image being stored in the means for storing under the control of the means for controlling.

25. The digital camera of claim 24, wherein the means for producing implements processing the set of captured images to produce the desired image, the desired image comprising selected image portions of the captured images from the set.

26. The digital camera of claim 25, wherein the set of captured images are stored in the means for storing, and wherein the means for producing further implement deleting the set of captured images from the means for storing after the desired image is produced and stored.

27. A method of producing a desired image from a captured image with a digital camera comprising:

processing within the digital camera a set of captured images taken with the digital camera to produce a desired image from the set, the desired image comprising selected image portions of the captured images from the set.

28. The method of producing of claim 27, further comprising:

capturing a plurality of images using the digital camera, the plurality of images comprising the set of captured images; and

storing the desired image in a memory of the digital camera.

29. The method of producing of claim 27, wherein the set of captured images comprises an image scene that is common to each captured image of the set.

30. The method of producing of claim 27, wherein the set of captured images includes an image scene, a captured image of the set having an imaged object that is undesired in the image scene, and wherein the desired image is an image of the image scene that is absent the imaged object, and wherein processing comprises removing the imaged object from the image scene.

31. The method of producing of claim 27, wherein the set of captured images comprises a first captured image including an image scene, and a second captured image including an imaged object, the desired image comprising the image scene and the imaged object together in an image, and wherein processing comprises adding the imaged object to the image scene.

32. The method of producing of claim 27, wherein processing comprises adding an imaged object to an image scene from the set of captured images and removing another imaged object from the image scene.