Virtual reality camera

• US 9,961,264 B2
• Filed: 08/29/2011
• Issued: 05/01/2018
• Est. Priority Date: 08/20/1999
• Status: Expired due to Fees

• Current Assignee: Cedar Lane Technologies Inc.
• Original Assignee: Intellectual Ventures I LLC (Intellectual Ventures LLC)
• Inventors: Teo, Patrick
• Primary Examiner(s): PHILIPPE, GIMS S
• Application Number:
  US13/220,579
• Publication Number:
  US 20120176515A1
• Time in Patent Office: 2,437 Days
• Field of Search: 348 36, 348 39, 348239, 348284, 3482181
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

A camera including a camera lens, acquisition circuitry receiving images via the camera lens, for acquiring a first field of view when the camera lens is in a first orientation and for acquiring a second field of view when the camera lens is in a second orientation, and a viewfinder displaying the second field of view when the camera lens is in the second orientation and displaying at least a portion of the first field of view at least partially composited with the second field of view.

Claims

1. A method performed by a computing device for combining images, the computing device having a processor, a memory, an image sensor, and a housing containing the processor, the memory, and the image sensor, the method comprising:

capturing, using the image sensor, a first image;

compositing an overlap strip from the first image onto a current field of view displayed via a viewfinder, such that while the image sensor is rotated, the overlap strip displayed via the viewfinder does not change while the current field of view displayed via the viewfinder does change;

capturing, using the image sensor, a second image;

identifying a first portion of the first image and a second portion of the second image;

for each of a plurality of offsets, tabulating a measure of error in using the offset to align the first image with the second image; and

creating a third image, based at least in part on one or more of the tabulated measures of error, that includes the first portion of the first image and the second portion of the second image.

2. The method of claim 1 wherein the first portion of the first image at least partially overlaps, in the third image, the second portion of the second image.

3. The method of claim 1 wherein identifying the second portion of the second image is based on the identified first portion of the first image.

4. The method of claim 3 wherein the second portion of the second image has a visual relationship with the first portion of the first image.

5. The method of claim 1 wherein the computing device includes a playback component and the third image is displayed on the playback component.

6. The method of claim 1 wherein the third image is mapped onto a surface geometry.

7. The method of claim 6 wherein the surface geometry is cylindrical.

8. The method of claim 6 wherein the surface geometry is spherical, cubical, rhombiodal, or elliptical.

9. The method of claim 1 further comprising:

capturing, using the image sensor, a fourth image;

identifying a third portion of the created third image and a fourth portion of the fourth image; and

creating a fifth image that includes the third portion of the created third image and the fourth portion of the fourth image.

10. The method of claim 9 wherein the fourth image is captured after the second image.

11. The method of claim 1 further comprising locking a focus of the image sensor such that the first image and the second image are captured at a same focal length.

12. The method of claim 1 wherein at least one of the measures of error is based at least in part on a normalized sum of absolute differences of color between the first image and the second image.

13. An image capture device comprising:

an image sensor;

a viewfinder;

a component configured to capture, using the image sensor, a first image;

a component configured to composite an overlap strip from the first image onto a current field of view displayed via the viewfinder, such that while the image sensor is rotated, the overlap strip displayed via the viewfinder does not change while the current field of view displayed via the viewfinder does change;

a component configured to capture, using the image sensor, a second image;

a component configured to identify a first portion of the first image and a second portion of the second image;

a component configured to, for each of a plurality of offsets, tabulate a measure of error in using the offset to align the first image with the second image; and

a component configured to create a third image, based at least in part on one or more of the tabulated measures of error, that includes the first portion of the first image and the second portion of the second image.

14. The image capture device of claim 13 wherein the first portion of the first image at least partially overlaps, in the third image, the second portion of the second image.

15. The image capture device of claim 13 wherein the second portion of the second image is identified based on the identified first portion of the first image.

16. The image capture device of claim 15 wherein the second portion of the second image has a visual relationship with the first portion of the first image.

17. The image capture device of claim 13, wherein the third image is mapped onto a surface geometry.

18. An apparatus for capturing and combining images comprising:

an image sensor configured to capture a first image and a second image;

a first component configured to identify a first portion of the first image and a second portion of the second image;

a second component configured to composite an overlap strip from the first image onto a current field of view displayed via a viewfinder, such that while the image sensor is rotated, the overlap strip displayed via the viewfinder does not change while the current field of view displayed via the viewfinder does change;

a third component configured to, for each of a plurality of offsets, tabulate a measure of error in using the offset to align the first image with the second image;

combination circuitry configured to create a third image, based at least in part on one or more of the tabulated measures of error, that includes the first portion of the first image and the second portion of the second image; and

a housing that contains the image sensor, the first component, the second component, and the combination circuitry.

19. The system of claim 18 wherein the first portion of the first image at least partially overlaps, in the third image, the second portion of the second image.

20. The system of claim 18 wherein the second portion of the second image is identified based on the identified first portion of the first image.

21. The system of claim 18 wherein the third image is mapped onto a surface geometry.