Panoramic image production

• US 20090021576A1
• Filed: 07/18/2007
• Published: 01/22/2009
• Est. Priority Date: 07/18/2007
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lavsky, Ehud, Shtainhart, Adar, Distanik, Israel, Ben-Ami, Eli, Linder, Natan, Armony-Shimoni, Lilach, Shenhav, Tom, Sorek, Noam, Bregman-Amitai, Orna
• Granted Patent: US 8,717,412 B2
• Time in Patent Office: Days
• US Class Current: 348/36
• CPC Class Codes: G03B 37/00 Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
• CPC Class Codes: G06T 2200/32 involving image mosaicing
• CPC Class Codes: G06T 2207/20092 Interactive image processing based on input by user
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen

Abstract

A method of assembling a panoramic image from a plurality of frames in a camera, the method comprising: (a) acquiring a video stream using a camera; (b) selecting an initial frame from the video stream for capture as a still image; (c) further selecting additional frames; and (d) stitching the additional frames to the initial frame in the camera to create a panoramic image.

Claims

1. A method of assembling a panoramic image from a plurality of frames in a camera, the method comprising:

(a) acquiring a video stream using a camera;

(b) selecting an initial frame from the video stream for capture as a still image;

(c) further selecting at least one additional frame; and

(d) stitching the at least one additional frame to the initial frame in the camera to create a panoramic image.

2. A method according to claim 1, wherein the camera is installed in a mobile phone handset.

3. A method according to claim 1, wherein at least one of the at least one additional frame is selected from the video stream.

4. A method according to claim 1, wherein at least one of the at least one additional frame is acquired as an additional still image.

5. A method according to claim 4, wherein the further selecting includes overlay alignment.

6. A method according to claim 1, wherein the further selecting includes detection of camera motion (CaMo).

7. A method according to claim 6, comprising providing feedback on CaMo.

8. A method according to claim 6, wherein an absence of CaMo triggers acquisition of an additional frame.

9. A method according to claim 1, wherein the selecting is performed manually by a user.

10. A method according to claim 1, comprising detection of at least one undesirable feature.

11. A method according to claim 10, wherein the undesirable feature comprises a face.

12. A method according to claim 1, wherein the further selecting is performed automatically by the camera.

13. A method according to claim 1, wherein the further selecting is performed manually by a user.

14. A method according to claim 1, wherein the panoramic image is of a 3D surface.

15. A method of providing a virtual 3D projection of a panoramic image in a camera, the method comprising:

(a) storing a panoramic image in a memory of a camera; and

(b) applying a projection algorithm to produce a virtual 3D projection of the panoramic image on a display of the camera.

16. A method according to claim 15, wherein the camera is installed in a mobile phone handset.

17. A method according to claim 15, comprising:

(c) selecting a projection algorithm so that the 3D projection emulates projection on a surface with desired characteristics.

18. A method according to claim 15, comprising:

(c) dynamically updating the device'"'"'s screen according to a changing point of view to emulate a live video of a real-world 3D scene.

19. A method according to claim 15, comprising:

(c) selecting a projection algorithm so that the 3D projection emulates projection on a surface from a desired angle.

20. A method according to claim 15, wherein the projection algorithm allows the user to dynamically change a projection angle to simulate a real-world look and feel.

21. A user interface for a mobile phone, the user interface adapted to aid the user to align a next frame of a panoramic image with a view area of a camera incorporated in the phone, the interface comprising:

(a) a motion direction indicator visible to a user; and

(b) a next frame alignment indication.

22. An interface according to claim 21, comprising a direction selection module adapted for selection of a motion direction for acquisition of the next frame.

23. An interface according to claim 21, wherein the visible motion direction indicator comprises at least a portion of an edge of the view area.

24. An interface according to claim 21, wherein the visible motion direction indicator comprises an arrow.

25. An interface according to claim 21, wherein a correct alignment of the next frame with the view area produces a stop signal which alerts the user to hold the camera in position so that the next frame can be acquired.

26. An interface according to claim 21, wherein the next frame alignment indication comprises an aiming object and an aiming target;

wherein alignment of the aiming object with the aiming target indicates that the next frame is properly aligned.

27. An interface according to claim 26, organized as a game in which scoring is based upon one or both of speed and quality of alignment of the aiming object with the aiming target.

28. Use of an interface according to claim 21 to create a matrix of frames which is panoramic in two different dimensions.

29. A method of assembling a panoramic image using a camera, the method comprising:

(a) acquiring at least one frame belonging to a panoramic image using the camera;

(b) interrupting the acquiring and changing an aiming direction of the camera;

(c) resuming acquisition of frames belonging to a panoramic image; and

(d) assembling the panoramic image from at least one frame acquired in (a) and at least one frame acquired in (c).

30. A method according to claim 29, wherein the camera is installed in a mobile phone handset.

31. A method according to claim 29, wherein the at least one frame not belonging to the panoramic image is excluded because it contains an interfering object.

32. A method according to claim 29, wherein the at least one frame not belonging to the panoramic image is acquired from a different position.

33. A method of producing a composite image on camera;

the method comprising;

(a) providing a first image on a display of the camera;

(b) selecting a second image;

(c) indicating a position on the first image; and

(d) applying the second image to the first image at the indicated position to produce a composite image.

34. A method according to claim 33, wherein the second image is smaller than the first image.

35. A method according to claim 33, wherein the camera is installed in a mobile phone handset.

36. A method according to claim 33, wherein the first image is a panoramic image.

37. A method according to claim 33, wherein the second image comprises a clip-art graphic image.

38. A method according to claim 33, wherein the second image comprises at least a portion of a photographic image.

39. A method according to claim 38, wherein the second image is acquired between two frames of a first image comprising a photographic panorama.

40. A method according to claim 38, comprising:

(e) assigning a degree of transparency to the second image.

41. A camera adapted to assemble a panoramic image from a plurality of frames, the camera comprising:

(a) a video acquisition module capable of providing a video stream;

(b) a selector module adapted to select an initial frame from the video stream for capture as a still image;

(c) a user interface adapted to guide a user in selecting additional frames; and

(d) a stitching module adapted to stitch the additional frames to the initial frame to create a panoramic image.

42. A camera according to claim 41, provided as part of a mobile phone handset.

43. A camera adapted to provide a virtual 3D projection of a panoramic image, the camera comprising:

(a) a memory adapted for storage therein of a panoramic image; and

(b) analytic circuitry adapted to apply a projection algorithm to produce a virtual 3D projection of the panoramic image on a display of the camera.

44. A camera according to claim 43, provided as part of a mobile phone handset.

45. A display screen of a mobile phone handset adapted to aid the user to align a next frame of a panoramic image with a view area of a camera incorporated in the handset, the handset comprising circuitry adapted for onscreen presentation of:

(a) a motion direction indicator; and

(b) a next frame alignment indication responsive to camera motion.

46. A camera comprising circuitry adapted to assemble a panoramic image, the camera comprising:

(a) a frame acquisition module for acquiring frames;

(b) a memory with plurality of frames stored therein, only some of the frames belonging to a panoramic image;

(c) a stitching engine adapted to identify those frames in the memory which belong to the panoramic image and assemble the identified frames in sequence.

47. A camera according to claim 46, provided as part of a mobile phone handset.

48. A camera comprising:

(a) a display adapted to present a first image;

(b) a user accessible library of second images;

(c) a selection module adapted for selection of a second image; and

(d) a user operable alignment module adapted to apply the second image to the first image at a selected location.

49. A camera according to claim 48, provided as part of a mobile phone handset.

50. A camera comprising:

(a) a user interface adapted for manual alignment of two frames via overlay to produce a pair of pre-aligned frames; and

(b) a stitching module adapted to receive the pre-aligned frames and perform an exact alignment.

51. A camera according to claim 50, provided as part of a mobile phone handset.