Method and an apparatus for generating image content

• US 8,848,066 B2
• Filed: 02/26/2013
• Issued: 09/30/2014
• Est. Priority Date: 12/06/2006
• Status: Expired due to Fees

• Current Assignee: Sony Europe Limited (Sony Group Corp.)
• Original Assignee: Sony Europe Limited (Sony Group Corp.)
• Inventors: Porter, Robert Mark Stefan, Gillard, Clive Henry, Stone, Jonathan James, Berry, David, Haynes, Simon Dominic
• Primary Examiner(s): Henn, Timothy J
• Application Number:
  US13/777,759
• Publication Number:
  US 20130163817A1
• Time in Patent Office: 581 Days
• Field of Search: 348/48, 348/143, 348/157, 348/218.1, 348/239, 382/293, 382/294, 33/48, 331/43, 331/57, 332/181, 332/39
• US Class Current: 348/218.1
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen

Abstract

A method and a system for generating image content. The method and system allow segments of a panoramic scene, to be generated with reduced distortion. The method and system reduce the amount of distortion by mapping pixel data onto a pseudo camera focal plane which is provided substantially perpendicularly to the focal location of the camera that captured the image. A camera arrangement can implement the method and system.

Claims

1. A method of generating image content, comprising:

receiving image data representing an image generated by a camera having a predetermined focal location;

generating segment image data representing a selected segment of the image by;

determining a substantially flat plane representing the selected segment, the substantially flat plane being positioned such that the flat plane lies substantially perpendicular to the predetermined focal location of the camera at a reference location in the selected segment, and

mapping pixel data onto the substantially flat plane in accordance with at least one parameter of the camera; and

outlining the segment image data on the image by determining an outline of the substantially flat plane and mapping the outline of the substantially flat plane onto the image in accordance with an angular position of the substantially flat plane relative to the image at the reference location.

2. The method according to claim 1, wherein the pixel data is derived from the camera.

3. The method according to claim 1, wherein the pixel data is derived from the image data, and wherein the at least one parameter of the camera is provided in association with the image data.

4. The method according to claim 1, further comprising:

reducing chromatic aberration generated by the camera in accordance with a comparison of red and green components and blue and green components of the image generated by the camera.

5. The method according to claim 1, further comprising:

detecting, in the image, an object based on an object detection algorithm; and

generating a position signal identifying a location of the detected object in the image.

6. The method according to claim 5, further comprising tracking the detected object between successive frames of the image based on an object tracking algorithm.

7. The method according to claim 5, further comprising identifying a segment of the image, in accordance with the position signal.

8. The method according to claim 7, wherein if between successive frames of the image tracking of the detected object between successive frames stalls, the method further comprises:

identifying an area of the image in accordance with the position signal; and

detecting, within the identified area and in accordance with the object detection algorithm, the object.

9. The method according to claim 1, further comprising displaying, on a display, the image.

10. The method according to claim 9, wherein the display is a super high definition display.

11. The method according to claim 1, further comprising distributing a representation of the image or part of the image and/or the segment image data.

12. The method according to claim 11, further comprising distributing ancillary data separately to the representation of the image or part of the image and/or the segment image data.

13. The method according to claim 12, wherein the ancillary data is metadata.

14. The method according to claim 1, wherein the camera has a wide angle lens.

15. The method according to claim 1, wherein the camera is a high resolution camera.

16. The method according to claim 15, wherein the image captured by the camera is an ultra high resolution image.

34. A non-transitory computer-readable storage medium including computer-readable instructions, which when executed by a computer causes the computer to perform the method of claim 1.

17. An image content generating apparatus, comprising:

an image receiving device operable to receive image data representing an image generated by a camera having a predetermined focal location; and

an image processing device operable to generate segment image data representing a selected segment of the image by;

determining a substantially flat plane representing the selected segment, the substantially flat plane being positioned such that the substantially flat plane lies substantially perpendicular to the predetermined focal location of the camera at a reference location in the selected segment, and

mapping pixel data onto the substantially flat plane in accordance with at least one parameter of the camera,

wherein the image processing device is operable to outline the segment image data on the image by determining an outline of the substantially flat plane and mapping the outline of the substantially flat plane onto the image in accordance with an angular position of the substantially flat plane relative to the image at the reference location.

18. The apparatus according to claim 17, wherein the pixel data is derived from the camera.

19. The apparatus according to claim 17, wherein the pixel data is derived from the image data, and wherein the at least one parameter of the camera is provided in association with the image data.

20. The apparatus according to claim 17, further comprising:

a chromatic aberration reducing device operable to reduce chromatic aberration generated by the camera in accordance with a comparison of red and green components and blue and green components of the image generated by the camera.

21. The apparatus according to claim 17, further comprising an object detecting device operable to:

detect, in the image, an object based on an object detection algorithm; and

generate a position signal identifying a location of the detected object in the image.

22. The apparatus according to claim 21, wherein the object detecting device is operable to track the detected object between successive frames of the image based on an object tracking algorithm.

23. The apparatus according to claim 21, wherein the object detecting device is operable to identify a segment of the image, in accordance with the position signal.

24. The apparatus according to claim 22, wherein if between the successive frames of the image tracking of the detected object between successive frames stalls, the object detecting device is further operable to:

identify an area of the image in accordance with the position signal; and

detect, within the identified area and in accordance with the object detection algorithm, the object.

25. The apparatus according to claim 17, further comprising a display operable to display the image.

26. The apparatus according to claim 17, further comprising a distributor operable to distribute a representation of the image or part of the image and/or the segment image data.

27. The apparatus according to claim 26, wherein the distributor is operable to distribute ancillary data separately to the representation of the image or part of the image and/or the segment image data.

28. The apparatus according to claim 27, wherein the ancillary data is metadata.

29. The apparatus according to claim 17, wherein the camera has a wide angle lens.

30. The apparatus according to claim 17, wherein the camera is a high resolution camera.

31. The apparatus according to claim 30, wherein the image captured by the camera is an ultra high resolution image.

32. A display device arranged to operate with an apparatus according to claim 26 and operable to display the representation of the image or at least part of the representation of the image and/or the segment image data, the device comprising:

a display for displaying the representation of the image or part of the image and/or the segment image data.

33. A display device according to claim 32, wherein the display is a super high definition display.