SYSTEMS AND METHODS FOR PRODUCING AN IMAGE VISUALIZATION

• US 20170109940A1
• Filed: 10/14/2015
• Published: 04/20/2017
• Est. Priority Date: 10/14/2015
• Status: Active Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Guo, Feng, Bi, Ning, Forutanpour, Bijan, Zhang, Tao, Ren, Jianfeng
• Granted Patent: US 10,262,466 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0147 comprising a device modifying the resolution of the displayed image
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/32 involving image mosaicing
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method performed by an electronic device is described. The method includes obtaining a combined image. The combined image includes a combination of images captured from one or more image sensors. The method also includes obtaining depth information. The depth information is based on a distance measurement between a depth sensor and at least one object in the combined image. The method further includes adjusting a combined image visualization based on the depth information.

Claims

1. A method performed by an electronic device, comprising:

obtaining a combined image, wherein the combined image comprises a combination of images captured from one or more image sensors;

obtaining depth information, wherein the depth information is based on a distance measurement between a depth sensor and at least one object in the combined image; and

adjusting a rendering geometry for a combined image visualization based on the depth information.

3. The method of claim 1, wherein adjusting the rendering geometry for the combined image visualization comprises adjusting the rendering geometry such that the at least one object is rendered on a vertical portion of the rendering geometry.

4. The method of claim 1, further comprising inserting at least one model into a three-dimensional space of the image visualization, wherein the model corresponds to the at least one object.

5. The method of claim 1, wherein the depth information indicates a distance between the depth sensor and a nearest object.

6. The method of claim 1, wherein the at least one object comprises a plurality of objects, and wherein the depth information indicates an average object distance between the depth sensor and the plurality of objects.

7. The method of claim 1, wherein the depth information is dynamic.

8. The method of claim 1, further comprising:

identifying a region of interest based on object detection; and

zooming at least a portion of the combined image visualization based on the region of interest.

9. The method of claim 1, further comprising reducing perspective distortion for the combined image visualization.

10. The method of claim 1, wherein the combined image visualization is a surround view.

2. (canceled)

11. An electronic device, comprising:

a processor configured to;

obtain a combined image, wherein the combined image comprises a combination of images captured from one or more image sensors;

obtain depth information, wherein the depth information is based on a distance measurement between a depth sensor and at least one object in the combined image; and

adjust a rendering geometry for a combined image visualization based on the depth information.

13. The electronic device of claim 11, wherein the processor is configured to adjust the rendering geometry such that the at least one object is rendered on a vertical portion of the rendering geometry.

14. The electronic device of claim 11, wherein the processor is configured to insert at least one model into a three-dimensional space of the image visualization, wherein the model corresponds to the at least one object.

15. The electronic device of claim 11, wherein the depth information indicates a distance between the depth sensor and a nearest object.

16. The electronic device of claim 11, wherein the at least one object comprises a plurality of objects, and wherein the depth information indicates an average object distance between the depth sensor and the plurality of objects.

17. The electronic device of claim 11, wherein the depth information is dynamic.

18. The electronic device of claim 11, wherein the processor is configured to:

identify a region of interest based on object detection; and

zoom at least a portion of the combined image visualization based on the region of interest.

19. The electronic device of claim 11, wherein the processor is configured to reduce perspective distortion for the combined image visualization.

20. The electronic device of claim 11, wherein the combined image visualization is a surround view.

12. (canceled)

21. An apparatus, comprising:

means for obtaining a combined image, wherein the combined image comprises a combination of images captured from one or more image sensors;

means for obtaining depth information, wherein the depth information is based on a distance measurement between a depth sensor and at least one object in the combined image; and

means for adjusting a rendering geometry for a combined image visualization based on the depth information.

23. The apparatus of claim 21, further comprising means for inserting at least one model into a three-dimensional space of the image visualization, wherein the model corresponds to the at least one object.

24. The apparatus of claim 21, wherein the depth information indicates a distance between the depth sensor and a nearest object.

25. The apparatus of claim 21, wherein the at least one object comprises a plurality of objects, and wherein the depth information indicates an average object distance between the depth sensor and the plurality of objects.

22. (canceled)

26. A computer-program product, comprising a non-transitory tangible computer-readable medium having instructions thereon, the instructions comprising:

code for causing an electronic device to obtain a combined image, wherein the combined image comprises a combination of images captured from one or more image sensors;

code for causing the electronic device to obtain depth information, wherein the depth information is based on a distance measurement between a depth sensor and at least one object in the combined image; and

code for causing the electronic device to adjust a rendering geometry for a combined image visualization based on the depth information.

28. The computer-program product of claim 26, further comprising code for causing the electronic device to insert at least one model into a three-dimensional space of the image visualization, wherein the model corresponds to the at least one object.

29. The computer-program product of claim 26, wherein the depth information indicates a distance between the depth sensor and a nearest object.

30. The computer-program product of claim 26, wherein the at least one object comprises a plurality of objects, and wherein the depth information indicates an average object distance between the depth sensor and the plurality of objects.

27. (canceled)