Imaging adjustment device and imaging adjustment method

• US 10,191,276 B2
• Filed: 12/04/2013
• Issued: 01/29/2019
• Est. Priority Date: 06/28/2013
• Status: Active Grant

• Current Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Original Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Inventors: Du, Lin, Zhang, Hongjiang
• Primary Examiner(s): Zalalee, Sultana M
• Application Number:
  US14/780,519
• Publication Number:
  US 20160103318A1
• Time in Patent Office: 1,882 Days
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 27/0025 for optical correction, e.g. distorsion, aberration
• CPC Class Codes: G02B 27/0068 having means for controlling the degree of correction, e.g. using phase modulators, movable elements controlling the phase of light using moving or deformable elements G02B26/06
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02C 7/081 Ophthalmic lenses with variable focal length
• CPC Class Codes: G02C 7/083 Electrooptic lenses
• CPC Class Codes: G02C 7/085 Fluid-filled lenses, e.g. electro-wetting lenses
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/20012 Locally adaptive
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes

Abstract

An imaging adjustment apparatus includes: an imaging analysis module, used to determine whether a current image of an object is deformed relative to an original image of the object, and when the current image is deformed, generate imaging correction information corresponding to the deformation; an imaging lens group, used to image the object, and including a plurality of subregions having adjustable imaging parameters; and a lens adjustment module, used to adjust an imaging parameter of a corresponding subregion of the imaging lens group according to the imaging correction information. An object can be imaged by using an imaging lens in which each subregion has adjustable imaging parameters, so as to adjust the imaging parameters for each subregion separately, thereby adjusting and correcting a perspective deformation that occurs on the object, preventing a perspective deformation from occurring on an image of the object acquired by a user, and improving user experience.

Claims

1. An apparatus, comprising:

a memory that stores executable instructions; and

a processor, coupled to the memory, that facilitates execution of the executable instructions to perform operations, comprising;

determining imaging correction information corresponding to correcting a deformation of a first image of an object from a first viewing angle relative to a second image of the object from a second viewing angle, wherein the deformation is a perspective deformation of the first image of the object relative to the second image of the object, wherein the perspective deformation results from an imaging receiver not being perpendicular to the object, and wherein the imaging receiver is an eye or an image recording device; and

adjusting at least one imaging parameter of a group of adjustable imaging parameters for at least one corresponding subregion of an imaging lens group used to cause the first image of the object from the first viewing angle, wherein the imaging lens group comprises a plurality of subregions having adjustable imaging parameters in the form of an array, wherein images, comprising the first image, formed by the imaging lens group are adaptable by adjusting portions of the imaging lens group to embody the group of adjustable imaging parameters, and wherein the adjusting the at least one imaging parameter corresponds to adjusting the first image of the object formed by the imaging lens group according to the imaging correction information resulting in an adjusted image, wherein;

the adjusted image is directed to the eye based on the adjusting the least one imaging parameter, and the imaging lens group is at least partially comprised in spectacles, or

the adjusted image is directed to the image recording device based on the adjusting the least one imaging parameter, and the image recording device comprises, at least in part, the imaging lens group.

2. The apparatus of claim 1, wherein the imaging correction information comprises deformation information corresponding to preset information attributed to the object.

3. The apparatus of claim 2, wherein the preset information of the object comprises shape information of an outer profile of the object.

4. The apparatus of claim 3, wherein the outer profile of the object is a rectangle, and the shape information of the outer profile of the object comprises aspect ratio information of the outer profile of the object.

5. The apparatus of claim 2, wherein the preset information of the object comprises information of a reference pattern in the object.

6. The apparatus of claim 2, wherein the determining the image correction information comprises:

determining, via an optical sensing device, the first image of the object from the first viewing angle.

7. The apparatus of claim 1, wherein the determining the image correction information comprises:

receiving, from a depth sensing device, depth information of the object.

8. The apparatus of claim 7, wherein the determining the image correction information comprises:

receiving, from a size sensing device, a size of the object.

9. The apparatus of claim 7, wherein the determining the image correction information comprises:

receiving, via an information receiving device of the apparatus, the depth information of the object from the depth sensing device.

10. The apparatus of claim 2, wherein the determining the image correction information comprises:

generating the imaging correction information to correct the first image based on the preset information attributed to the object.

11. The apparatus of claim 1, wherein the imaging lens group comprises a first lens and a second lens, wherein an optical attribute of the first lens is adjustable, and wherein adjustment of the optical attribute of the first lens affects imaging at a portion of the first image.

12. The apparatus of claim 1, wherein the at least one imaging parameter comprises a focal length.

13. The apparatus of claim 12, wherein the at least one imaging parameter further comprises relative positions of lenses of the imaging lens group.

14. The apparatus of claim 1, wherein the portions of the imaging lens group are distributed in an array.

15. The apparatus of claim 1, wherein the portions of the imaging lens group are distributed in a rectangular array.

16. The apparatus of claim 1, wherein the portions of the imaging lens group are distributed in a radially concentric array.

17. The apparatus of claim 1, wherein the determining the imaging correction information comprises:

determining refractive error correction information corresponding to correcting a refractive error at an imaging device for imaging the first image of the object.

18. The apparatus of claim 1, wherein the spectacles comprise all of the imaging lens group.

19. A method, comprising:

determining, by a system comprising a processor, whether a current image of an object corresponding to a first orientation of a current image sensor device to the current image is deformed according to a deformation relative to an original image of the object corresponding to a second orientation of an original image sensor device to the original image, and when the current image is deformed, generating imaging correction information corresponding to the deformation, wherein the deformation is a perspective deformation of the current image of the object relative to the original image of the object, wherein the perspective deformation results from an imaging receiver not being normal to the object, and wherein the imaging receiver is an eye or an optical energy recording device; and

adjusting at least one imaging parameter of at least one corresponding subregion of an imaging lens group according to the imaging correction information, wherein the imaging lens group comprises a plurality of subregions having adjustable imaging parameters in the form of an array, wherein;

the eye receives an adjusted image based on the adjusting the least one imaging parameter, and the imaging lens group is at least partially comprised in eyeglasses, or

the optical energy recording device receives the adjusted image based on the adjusting the least one imaging parameter, and the optical energy recording device comprises, at least in part, the imaging lens group.

20. The method of claim 19, wherein the determining whether the current image of the object is deformed relative to the original image of the object comprises:

determining whether the current image of the object is deformed relative to the original image of the object according to current image information of the object and preset information of the object, and when the deformation occurs, generating deformation information.

21. The method of claim 20, wherein the preset information of the object comprises shape information of an outer profile of the object.

22. The method of claim 21, wherein the outer profile of the object is a rectangle, and the shape information of the outer profile of the object comprises aspect ratio information of the outer profile of the object.

23. The method of claim 20, wherein the preset information of the object comprises information of a reference pattern associated with the object.

24. The method of claim 20, wherein the determining whether the current image of the object is deformed relative to the original image of the object comprises acquiring the current image information of the object via the current image sensor device.

25. The method of claim 19, wherein the determining whether the current image of the object is deformed relative to the original image of the object comprises generating corresponding deformation information according to depth information of the object relative to the current image sensor device.

26. The method of claim 25, wherein the determining whether the current image of the object is deformed relative to the original image of the object comprises acquiring the depth information of the object relative to the current image sensor device.

27. The method of claim 19, wherein the imaging lens group comprises at least two lenses, and wherein a part corresponding to each subregion of at least one lens of the at least two lenses has an adjustable imaging parameter of the adjustable imaging parameters.

28. The method of claim 19, wherein the at least one imaging parameter comprises a focal length value.

29. The method of claim 28, wherein the at least one imaging parameter further comprises relative position values of lenses of the imaging lens group.

30. The method of claim 19, wherein the plurality of subregions having the adjustable imaging parameters is distributed in an array.

31. The method of claim 19, wherein the plurality of subregions having the adjustable imaging parameters is distributed in a rectangular array.

32. The method of claim 19, wherein the plurality of subregions having the adjustable imaging parameters is distributed in a radially concentric array.

33. The method of claim 19, wherein the generating the image correction information comprises generating, in response to determining an instance of a refractive error occurring on the current image sensor, imaging correction information comprising correction information corresponding to the instance of the refractive error.

34. A computer readable storage device comprising executable instructions that, in response to execution, cause an image adjustment device comprising a processor to perform operations, comprising:

in response to determining that a current image of an object is deformed, generating imaging correction information corresponding to a manner in which the image is deformed, wherein the determining that the current image is deformed is relative to an original image of the object, wherein a deformation of the current image of the object is a perspective deformation of the current image of the object relative to the original image of the object, wherein the current image of the object corresponds to a current viewing angle, wherein the original image of the object corresponds to an original viewing angle that is a different viewing angle than the current viewing angle, wherein the perspective deformation results from an imaging receiver not being orthogonal to the object, and wherein the imaging receiver is a human eye or an image recording device; and

adjusting at least one imaging parameter of at least one corresponding subregion of a plurality of subregions of an imaging lens group according to the imaging correction information, resulting in an adjusted image, wherein the plurality of subregions are in the form of an array and have respective adjustable imaging parameters, wherein;

the adjusted image is angled toward the human eye based on the adjusting the least one imaging parameter, and the imaging lens group is at least partially comprised in glasses, or

the adjusted image is angled toward the image recording device based on the adjusting the least one imaging parameter, and the image recording device comprises, at least in part, the imaging lens group.

35. The computer readable storage device of claim 34, wherein the operations further comprise determining the current image via an image capture device at a position subjected to the current viewing angle.