IMAGE PROCESSING METHOD, IMAGE PROCESSING DEVICE AND DISPLAY SYSTEM

• US 20170019595A1
• Filed: 07/13/2016
• Published: 01/19/2017
• Est. Priority Date: 07/14/2015
• Status: Abandoned Application

• Current Assignee: Prolific Technology Inc.
• Original Assignee: Prolific Technology Inc.
• Inventors: CHANG, Hsin-Yueh, HSU, Heng-Chi, CHEN, Guan-Yu
• Application Number:
  US15/209,742
• Publication Number:
  US 20170019595A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 13/0005 having F-Theta characteristic scanning systems employing movable or deformable optical elements G02B26/10
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2210/22 Cropping
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

An image processing device including an image obtaining circuit, a storage module and an image processing module is provided. The image obtaining circuit is for receiving a first fisheye image and a second fisheye image. The storage module is for storing a fisheye lens information. The image processing module is coupled to the image obtaining circuit and the storage module for generating a first converted image and a second converted image by converting the first and second fisheye images with panoramic coordinate conversion according to the fisheye lens information and stitching the first and second converted images to generate a panoramic image.

Claims

1. An image processing device, comprising:

an image obtaining circuit for receiving a first fisheye image and a second fisheye image;

a storage module for storing a fisheye lens information; and

an image processing module coupled to the image obtaining circuit and the storage module for converting the first and second fisheye images with panoramic coordinate conversion according to the fisheye lens information to generate a first converted image and a second converted image and stitching the first and second converted images to generate a panoramic image.

2. The image processing device according to claim 1, wherein the image processing module comprises:

an element for calculating coordinate conversion relationship between the first and second fisheye images and the panoramic image according to the fisheye lens information; and

an element for converting the first and second fisheye images into the first and second converted images according to the coordinate conversion relationship.

3. The image processing device according to claim 1, wherein the image processing module comprises:

an element for cropping the first and second converted images to generate a first cropped image and a second cropped image respectively;

an element for smoothing the edges of the first and second cropped images to generate a first to-be-stitched image and a second to-be-stitched image respectively; and

an element for stitching the first and second to-be-stitched images to generate a panoramic image.

4. The image processing device according to claim 1, wherein the fisheye lens information comprises a lens center position of a first fisheye lens module for capturing the first fisheye image and a lens center position of a second fisheye lens module for capturing the second fisheye image.

5. The image processing device according to claim 4, wherein the first fisheye and second fisheye lens modules are oppositely disposed on two sides of an optical axis around a reference dummy line and facing outwardly.

6. The image processing device according to claim 1, wherein the panoramic image is 720°

.

7. The image processing device according to claim 1, further comprising:

a user interface for selecting a viewing mode in response to an external instruction, such that the panoramic image is converted to a display image corresponding to the viewing mode.

8. The image processing device according to claim 7, wherein the viewing mode comprises sphere mode, panorama mode and fisheye mode.

9. An image processing method, comprising:

receiving a first fisheye image and a second fisheye image;

converting the first and second fisheye images with panoramic coordinate conversion according to a fisheye lens information to generate a first converted image and a second converted image; and

stitching the first and second converted images to generate a panoramic image.

10. The image processing method according to claim 9, further comprising:

calculating coordinate conversion relationship between the first and second fisheye images and the panoramic image according to the fisheye lens information; and

converting the first and second fisheye images into the first and second converted images according to the coordinate conversion relationship.

11. The image processing method according to claim 9, further comprising:

cropping the first and second converted images to generate a first cropped image and a second cropped image respectively;

smoothing the edges of the first and second cropped images to generate a first to-be-stitched image and a second to-be-stitched image respectively; and

stitching the first to-be-stitched image and the second to-be-stitched image to generate a panoramic image.

12. The image processing method according to claim 9, wherein the fisheye lens information comprises a lens center position of a first fisheye lens module for capturing the first fisheye image and a lens center position of a second fisheye lens module for capturing the second fisheye image.

13. The image processing method according to claim 12, wherein the first fisheye and second fisheye lens modules are oppositely disposed on two sides of an optical axis around a reference dummy line and facing outwardly.

14. The image processing method according to claim 9, wherein the panoramic image is 720°

.

15. The image processing method according to claim 9, further comprising:

selecting a viewing mode in response to an external instruction through a user interface, such that the panoramic image is converted to a display image corresponding to the viewing mode.

16. The image processing method according to claim 15, wherein the viewing mode comprises sphere mode, panorama mode and fisheye mode.

17. A display system, comprising:

an image capturing device, comprising;

a first fisheye lens module for capturing a first fisheye image;

a second fisheye lens module for capturing a second fisheye image; and

a transmission circuit for outputting the first and second fisheye images in the form of streams; and

an image processing device, comprising;

an image obtaining circuit for receiving the first and second fisheye images from the image capturing device;

a storage module for storing a fisheye lens information; and

an image processing module coupled to the image obtaining circuit and the storage module for converting the first and second fisheye images with panoramic coordinate conversion according to the fisheye lens information to generate a first converted image and a second converted image and stitching the first and second converted images to generate a panoramic image.

18. The display system according to claim 17, wherein the first fisheye and second fisheye lens modules are oppositely disposed on two sides of an optical axis around a reference dummy line and facing outwardly.

19. The display system according to claim 17, wherein the image processing device further comprises:

a user interface for selecting a viewing mode in response to an external instruction, such that the panoramic image is converted to a display image corresponding to the viewing mode.

20. The display system according to claim 19, wherein the viewing mode comprises sphere mode, panorama mode and fisheye mode.