Imaging device and imaging method

• US 10,481,396 B2
• Filed: 12/04/2013
• Issued: 11/19/2019
• Est. Priority Date: 06/28/2013
• Status: Active Grant

• Current Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Original Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Inventors: Du, Lin, Zhang, Hongjiang
• Primary Examiner(s): Khan, Ibrahim A
• Application Number:
  US14/779,968
• Publication Number:
  US 20160103323A1
• Time in Patent Office: 2,176 Days
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed

Abstract

An apparatus includes: an imaging lens module, used to image at least one object, and including a plurality of subregions having adjustable imaging parameters; a position sensing module, used to obtain position information of at least one object relative to an imaging apparatus; an information processing module, used to determine an imaging parameter of a corresponding subregion of the imaging lens module according to the position information of at least one object relative to the imaging apparatus; and a lens adjustment module, used to adjust the imaging parameter of the corresponding subregion of the imaging lens module according to the determined imaging parameter. The apparatus can adjust an imaging parameter for regions corresponding to a plurality of target objects at different distances in a visual field, and enable a user to watch objects at different distances in a visual field comfortably, thereby improving user experience.

Claims

1. An imaging apparatus, comprising:

an imaging lens module configured to project at least one image, directly to at least one eye of a user, of multiple objects at different distances from the apparatus, and comprising a plurality of subregions, wherein the imaging lens module comprises at least one lens, imaging parameters of each of the plurality of subregions are adjustable, and the plurality of subregions are subregions physically independent from each other, or logical subregions obtained by logically dividing one physically integral imaging lens module;

a processor, communicatively coupled to a memory that stores computer-executable instructions, that executes or facilitates execution of the computer-executable instructions to perform operations comprising;

obtain position information of the multiple objects relative to the apparatus;

determine the imaging parameters of multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the apparatus, wherein each of the multiple objects corresponds to one or more subregions of the multiple subregions; and

adjust, concurrently, the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects respectively based on the imaging parameters.

2. The apparatus of claim 1, wherein the operations further comprise:

learn corresponding imaging parameters associated with the at least one eye of the user acquiring expected images of objects at a plurality of distances, and obtain refractive examination information corresponding to the at least one eye of the user.

3. The apparatus of claim 2, wherein the operations further comprise:

determine an imaging parameter of the imaging parameters of at least one corresponding subregion for each object based on a respective distance of each object relative to the imaging lens module and the refractive examination information.

4. The apparatus of claim 3, wherein the further operations further comprise:

obtain other imaging parameters of other subregions between subregions corresponding to each object using a two-dimensional interpolation.

5. The apparatus of claim 1, wherein the operations further comprise:

determine respective distances of the multiple objects relative to the imaging lens module based on the position information of the multiple objects relative to the imaging apparatus.

6. The apparatus of claim 1, wherein the operations further comprise:

determine the multiple subregions corresponding to the multiple objects on the imaging lens module.

7. The apparatus of claim 1, wherein the operations further comprise:

determine a relative position relationship among the imaging lens module, the position sensing module, and the at least one eye of the user.

8. The apparatus of claim 1, wherein operations further comprise:

determine an imaging parameter of the imaging parameters of a corresponding subregion of the multiple corresponding subregions of the imaging lens module based on movement gesture information of the imaging apparatus.

9. The apparatus of claim 8, wherein the operations further comprise:

predict another imaging parameter of another corresponding subregion of the multiple objects at a next moment after a current moment based on relative movement gesture information of the imaging apparatus and the multiple objects, and the imaging parameter of the corresponding subregion of the multiple corresponding subregions of the multiple objects at the current moment.

10. The apparatus of claim 8, wherein the operations further comprise:

adjust respective imaging parameters of each subregion, of the multiple corresponding subregions, of the imaging lens module to a set common imaging parameter when a movement speed of the imaging apparatus is determined to exceed a set threshold value.

11. The apparatus of claim 8, wherein the operations further comprise:

adjust respective imaging parameters of each subregion, of the multiple corresponding subregions, of the imaging lens module to a mean value of imaging parameters of the multiple corresponding subregions of the imaging lens module at a previous moment when a movement speed of the imaging apparatus is determined to exceed a set threshold value.

12. The apparatus of claim 8, wherein the operations further comprise:

acquire the movement gesture information of the imaging apparatus.

13. The apparatus of claim 12, wherein the movement gesture information of the imaging apparatus comprises at least one of relative movement gesture information of the imaging apparatus and the multiple objects, or movement speed information of the imaging apparatus.

14. The apparatus of claim 1, wherein the operations further comprise:

perform smoothing processing of time on respective current imaging parameters of each subregion of the multiple corresponding subregions based on history information of the imaging parameter of each subregion.

15. The apparatus of claim 1, wherein the operations further comprise:

perform smoothing processing of space on the imaging parameter of each subregion of the multiple corresponding subregions based on the imaging parameter of each subregion of the imaging lens module.

16. The apparatus of claim 1, wherein an imaging parameter of the imaging parameters of a subregion of the multiple subregions comprises at least one of a shape or a refractive index of a lens of the multiple corresponding subregions.

17. The apparatus of claim 1, wherein the plurality of subregions of the imaging lens module are distributed in an array.

18. The apparatus of claim 17, wherein the plurality of subregions are distributed in a rectangular array.

19. The apparatus of claim 17, wherein the plurality of subregions are distributed in a radially concentric array.

20. The apparatus of claim 1, wherein the operations further comprise:

acquire position and depth information of the multiple objects relative to the imaging apparatus.

21. The apparatus of claim 1, further comprising:

an image sensor configured to acquire image information of the multiple objects.

22. The apparatus of claim 1, wherein the imaging apparatus is eyeglasses.

45. The method of claim 22, wherein if the distance between an object and the imaging apparatus is 1 m, the imaging parameter of the subregion corresponding to the object corresponds to the refractivity of −

5.75; and

if the distance between an object and the imaging apparatus is 0.8 m, the optimal refractivity corresponding to the distance of 0.8 m is obtained through an interpolation method according to corresponding optimal refractivities of 0.5 m and 1 m.

23. A method, comprising:

obtaining, by a system comprising a processor, position information of multiple objects at different distances relative to an imaging apparatus;

determining, by the system, imaging parameters of multiple subregions of an imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus, wherein each of the multiple objects corresponds to one or more subregions of the multiple subregions, wherein the imaging lens module comprises at least one lens and is used to project at least one image, directly to at least one eye of a user, of the multiple objects, and further comprises a plurality of subregions, wherein the imaging parameters of each of the plurality of subregions are adjustable, and the plurality of subregions are subregions physically independent from each other, or logical subregions obtained by logically dividing one physically integral imaging lens module; and

adjusting, by the system concurrently, the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects respectively based on the imaging parameters.

24. The method according to claim 23, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises:

determining corresponding imaging parameters of the imaging parameters in response to acquisition of expected images of the-multiple objects at a plurality of distances by the at least one eye of a user, and obtaining refractive examination information corresponding to the at least one eye of a user.

25. The method of claim 24, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises:

determining an imaging parameter of the imaging parameters of at least one corresponding subregion for each object based on a respective distance of each object relative to the imaging lens module and the refractive examination information.

26. The method of claim 25, wherein other imaging parameters of other subregions between the plurality of subregions corresponding to each object are obtained through a two-dimensional interpolation.

27. The method of claim 23, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises:

determining distances of the multiple objects relative to the imaging lens module based on the position information of the multiple objects relative to the imaging apparatus.

28. The method of claim 23, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises:

determining the multiple subregions corresponding to the multiple objects on the imaging lens module.

29. The method according to of claim 23, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises:

determining a relative position relationship among the imaging lens module, the position sensing module, and the at least one eye of the user.

30. The method of claim 23, further comprising:

determining, by the system, an imaging parameter of the imaging parameters of a corresponding subregion of the multiple corresponding subregions of the imaging lens module based on movement gesture information of the imaging apparatus.

31. The method of claim 30, wherein the determining the imaging parameter of the corresponding subregion of the multiple corresponding subregions of the imaging lens module based on the movement gesture information of the imaging apparatus comprises:

predicting the imaging parameter of the corresponding subregion of the multiple objects at a next moment after a current moment based on relative movement gesture information of the imaging apparatus and the multiple objects, and the imaging parameter of the corresponding subregions of the multiple corresponding subregions of the multiple objects at the current moment.

32. The method of claim 30, wherein the determining the imaging parameter of the corresponding subregion of multiple corresponding subregions of the imaging lens module based on the movement gesture information of the imaging apparatus comprises:

adjusting respective imaging parameters of each subregion of the plurality of subregions of the imaging lens module to a set common imaging parameter in response to determining a movement speed of the imaging apparatus has exceeded a set threshold value.

33. The method of claim 30, wherein the determining the imaging parameter of the corresponding subregion of the multiple corresponding subregions of the imaging lens module based on the movement gesture information of the imaging apparatus comprises:

adjusting respective imaging parameters of each subregion of the plurality of subregions of the imaging lens module to a mean value of imaging parameters of the plurality of subregions of the imaging lens module at a previous moment in response to determining a movement speed of the imaging apparatus has exceeded a set threshold value.

34. The method of claim 30, further comprising:

acquiring, by the system, the movement gesture information of the imaging apparatus.

35. The method of claim 34, wherein the movement gesture information of the imaging apparatus comprises at least one of relative movement gesture information of the imaging apparatus and the object, or movement speed information of the imaging apparatus.

36. The method of claim 23, further comprising:

performing, by the system, smoothing processing of time on a respective current imaging parameter of each subregion of the plurality of subregions based on history information of the imaging parameter of each subregion.

37. The method of claim 23, further comprising:

performing, by the system, smoothing processing of space on the imaging parameter of each subregion of the plurality of subregions based on the imaging parameter of each subregion of the imaging lens module.

38. The method of claim 23, wherein an imaging parameter of the imaging parameters of a subregion of the multiple subregions comprises at least one of a shape or a refractive index of a lens of the multiple corresponding subregions.

39. The method of claim 23, wherein the plurality of subregions of the imaging lens module is distributed in an array.

40. The method of claim 39, wherein the plurality of subregions is distributed in a rectangular array.

41. The method of claim 39, wherein the plurality of subregions are distributed in a radially concentric array.

42. The method of claim 23, wherein the obtaining the position information of the multiple objects at different distances relative to the imaging apparatus comprises:

acquiring, by the system, position and depth information of the multiple objects relative to the imaging apparatus.

43. The method of claim 23, wherein the obtaining the position information of the multiple objects at different distances relative to the imaging apparatus comprises:

acquiring image information of the multiple objects.

44. A non-transitory computer readable medium comprising executable instructions that, in response to execution, cause a device comprising a processor to perform operations, comprising:

obtaining position information of multiple objects relative to an imaging apparatus;

determining imaging parameters of multiple subregions of an imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus, wherein each of the multiple objects corresponds to one or more subregions of the multiple subregions, wherein the imaging lens module comprises at least one lens and is used to project at least one image, directly to at least one eye of a user, of the multiple objects, and further comprises a plurality of subregions, wherein the imaging parameters of each of the plurality of subregions is adjustable, and the plurality of subregions are subregions physically independent from each other, or logical subregions obtained by logically dividing one physically integral imaging lens module; and

adjusting, concurrently, the imaging parameters of multiple subregions of the imaging lens module corresponding to the multiple objects respectively based on the imaging parameters.

46. The non-transitory computer readable medium of claim 44, wherein the multiple subregions of the imaging lens module are distributed in an array.

47. The non-transitory computer readable medium of claim 46, wherein the multiple subregions are distributed in a rectangular array.

48. The non-transitory computer readable medium of claim 46, wherein the plurality of subregions are distributed in a radially concentric array.