Display device, computer program, and computer-implemented method

• US 9,412,149 B2
• Filed: 12/09/2014
• Issued: 08/09/2016
• Est. Priority Date: 02/10/2011
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Suzuki, Akihiro, Ogino, Ryoji
• Primary Examiner(s): Itskovich, Mikhail
• Application Number:
  US14/564,713
• Publication Number:
  US 20150091939A1
• Time in Patent Office: 609 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/20112 Image segmentation details
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: G09G 5/37 Details of the operation on graphic patterns G09G5/38 takes precedence
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/815 for controlling the resolution by using a single image
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

A method of processing an image includes receiving an omnidirectional image. An instruction is received with a processor to process the omnidirectional image to generate a rectangular image, in response to user input via a display on the omnidirectional image. At least one intermediate image is generated showing a transition between the omnidirectional image and the rectangular image.

Claims

1. A method for processing an image, the method comprising:

receiving an omnidirectional image;

receiving, with a processor, an instruction to process the omnidirectional image to generate a rectangular image, in response to user input via a display on the omnidirectional image; and

generating at least two intermediate images showing a dewarping transition between the omnidirectional image and the rectangular image, including generating a second intermediate image having a greater amount of correction for distortion than a first intermediate image.

2. The method according to claim 1, wherein

the at least two intermediate images comprise an image representing an area smaller than an area represented in the omnidirectional image, captured by a camera having a fish eye lens, and the area is larger than an area represented in the rectangular image and identified via the user input on the omnidirectional image on the display.

3. The method according to claim 1, further comprising:

generating at least one additional rectangular image that is generated based on a moving instruction received to move a display area for which the rectangular image is generated,

wherein the at least one additional rectangular image represents an area, being different from an area represented in the rectangular image, in the omnidirectional image, the omnidirectional image having distortion, and wherein the rectangular image and the additional rectangular image are generated by correcting the distortion.

4. The method according to claim 3, wherein

the at least one additional rectangular image is generated for continuous display based on the moving instruction, the at least one additional rectangular image being moved across the display in accordance with a movement of the received moving instruction.

5. The method according to claim 3, wherein

the at least one additional rectangular image is generated for continuous display based on a drag operation, the at least one additional rectangular image being moved across the display in accordance with a movement of the received moving instruction.

6. The method according to claim 1, further comprising applying at least one correction parameter to the omnidirectional image to generate the rectangular image.

7. The method according to claim 1, wherein

the omnidirectional image appears distorted on the display as a distance from a center of the omnidirectional image increases.

8. The method according to claim 1, wherein

the at least two intermediate images comprise a sequence of images.

9. The method according to claim 1, further comprising:

setting a time parameter for the display of the rectangular image based upon at least one characteristic of the user input.

10. The method according to claim 1, wherein the user input comprises a dragging operation on an outer area of the omnidirectional image on the display toward a center of the omnidirectional image on the display.

11. The method according to claim 1, wherein

the rectangular image is generated based upon a type and position of the user input.

12. The method according to claim 1, further comprising:

enlarging or reducing the rectangular image for display in response to received user input.

22. The method according to claim 1, wherein the at least two intermediate images are stretched in one direction during the dewarping transition.

23. The method according to claim 1, wherein the at least two intermediate images are stretched in two directions during the dewarping transition.

26. The method for processing an image according to claim 1, further comprising generating a clipped image that represents a first area smaller than an area represented in the omnidirectional image and is superimposed on the omnidirectional image.

27. The method for processing an image according to claim 26, further comprising changing a size of the clipped image superimposed on the omnidirectional image in response to user input.

28. The method for processing an image according to claim 26, wherein an initial display position of the clipped image overlaps an area from which the clipped image was clipped in the omnidirectional image.

29. The method for processing an image according to claim 26, further comprising generating an additional clipped image that represents a second area, different from the first area, smaller than the area represented in the omnidirectional image and is superposed on the clipped image.

30. The method for processing an image according to claim 1, further comprising generating two panoramic images by correcting a distortion of the omnidirectional image.

31. The method for processing an image according to claim 30, wherein a scrolling operation performed on one of the two panoramic images causes scrolling of both of the two panoramic images.

32. The method for processing an image according to claim 30, wherein a first panoramic image of the two panoramic images comprises a half of the omnidirectional image and a second panoramic image of the two panoramic images comprises the other half of the omnidirectional image.

13. A method for processing an image, the method comprising:

receiving a circular omnidirectional image;

receiving, with a processor, an instruction to process the circular omnidirectional image to generate a rectangular image, in response to user input via a display on the circular omnidirectional image; and

generating at least one intermediate image showing a dewarping transition between the circular omnidirectional image and the rectangular image, the at least one intermediate image representing an area smaller than an area represented in the omnidirectional image and the area is larger than an area represented in the rectangular image.

14. The method according to claim 13, wherein

a display of the rectangular image is superimposed upon a display of the circular omnidirectional image corresponding to a respective location in the circular omnidirectional image.

15. The method according to claim 13, wherein

the user input comprises a touch input, the touch input comprising:

at least one of a tapping operation, a dragging operation, a flicking operation, a pinching out operation, a pinching in operation, and a rotation operation.

16. The method according to claim 13, further comprising:

receiving a position of the user input with respect to a position on the circular omnidirectional image on the display.

17. The method according to claim 13, wherein

the circular omnidirectional image appears distorted on the display as a distance from a center of the circular omnidirectional image increases.

18. The method according to claim 13, wherein

the rectangular image is a clipped image based on an area identified via the user input on the circular omnidirectional image on the display.

19. The method according to claim 13, wherein the user input comprises a dragging operation on an outer area of the circular omnidirectional image on the display toward a center of the circular omnidirectional image on the display.

24. The method according to claim 13, further comprising generating two intermediate images showing the dewarping transition between the omnidirectional image and the rectangular image, wherein a second image of the two intermediate images includes a lesser amount of distortion than a first image of the two intermediate images.

25. The method according to claim 24, wherein the at least two intermediate images are stretched in two directions during the dewarping transition.

33. The method for processing an image according to claim 13, further comprising generating a clipped image that represents a first area smaller than an area represented in the omnidirectional image and is superimposed on the omnidirectional image.

34. The method for processing an image according to claim 33, further comprising changing a size of the clipped image superimposed on the omnidirectional image in response to user input.

35. The method for processing an image according to claim 33, wherein an initial display position of the clipped image overlaps an area from which the clipped image was clipped in the omnidirectional image.

36. The method for processing an image according to claim 33, further comprising generating an additional clipped image that represents a second area, different from the first area, smaller than the area represented in the omnidirectional image and is superposed on the clipped image.

37. The method for processing an image according to claim 13, further comprising generating two panoramic images by correcting a distortion of the omnidirectional image.

38. The method for processing an image according to claim 37, wherein a scrolling operation performed on one of the two panoramic images causes scrolling of both of the two panoramic images.

39. The method for processing an image according to claim 37, wherein a first panoramic image of the two panoramic images comprises a half of the omnidirectional image and a second panoramic image of the two panoramic images comprises the other half of the omnidirectional image.

20. A non-transitory computer-readable storage medium encoded with an executable computer program for processing an image and that, when executed by a processor, causes the processor to perform operations comprising:

receiving an omnidirectional image;

receiving, with a processor, an instruction to process the omnidirectional image to generate a rectangular image, in response to user input via a display on the omnidirectional image; and

generating at least two intermediate images showing a dewarping transition between the omnidirectional image and the rectangular image, including generating a second intermediate image having a greater amount of correction for distortion than a first intermediate image.

21. A method for displaying an image, the method comprising:

displaying an omnidirectional image on a display; and

receiving an instruction input on the displayed omnidirectional image, the instruction instructing a processor to generate a rectangular image,

in response to the received instruction, generating at least one two intermediate image images showing a dewarping transition between the omnidirectional image and the rectangular image, including generating a second intermediate image having a greater amount of correction for distortion than a first intermediate image.