Imaging to facilitate object gaze

• US 9,961,257 B2
• Filed: 07/02/2014
• Issued: 05/01/2018
• Est. Priority Date: 09/30/2013
• Status: Active Grant

• Current Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Original Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Inventors: Yu, Kuifei, Du, Lin, Shi, Wei
• Primary Examiner(s): Hsu, Amy
• Application Number:
  US14/904,936
• Publication Number:
  US 20160150154A1
• Time in Patent Office: 1,399 Days
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0147 comprising a device modifying the resolution of the displayed image
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

An imaging method includes determining a gazed object of a user according to an image at the user'"'"'s eye fundus; and changing a size of a target image of the gazed object according to a predetermined zooming rule. A device comprises: an object determination unit configured to determine a gazed object of a user according to an image at the user'"'"'s eye fundus; and a processing unit configured to change a size of a target image of the gazed object according to a predetermined zooming rule. The size of the target image can be changed by optical zoom processing, so that the user feels that the gazed object is observed with an appropriate size of the image at the eye fundus at an appropriate distance, thereby facilitating the user to observe the gazed object and improving the observation efficiency.

Claims

1. A method, comprising:

determining, by a system comprising a processor, a gazed object of a user according to an image at an eye fundus of the user; and

changing a size of a target image of the gazed object at the eye fundus according to a predetermined zooming rule.

2. The method of claim 1, wherein the changing the size of the target image includes:

in a case where the user has observed the gazed object for a time period exceeding a predetermined time, changing the size of the target image of the gazed object at the eye fundus according to the predetermined zooming rule.

3. The method of claim 1, wherein the method also includes:

presetting a target area ratio of the target image, and a buffer zone of the target area ratio,

and the changing the size of the target image includes;

determining an actual area ratio of the target image at the eye fundus; and

changing the size of the target image according to the target area ratio, the actual area ratio, and the buffer zone.

4. The method of claim 3, wherein the changing the size of the target image according to the target area ratio, the actual area ratio, and the buffer zone includes:

in the case where the actual area ratio is smaller than the target area ratio and the actual area ratio is outside the buffer zone, zooming-in the target image to the target area ratio.

5. The method of claim 3, wherein the changing the size of the target image according to the target area ratio, the actual area ratio, and the buffer zone includes:

in the case where the actual area ratio is greater than the target area ratio and the actual area ratio is outside the buffer zone, zooming-out the target image to the target area ratio.

6. The method of claim 3, wherein the buffer zone is zero.

7. The method of claim 1, wherein the changing the size of the target image includes:

determining the actual area ratio of the target image at the eye fundus;

determining a corresponding zooming-in factor according to the actual area ratio; and

changing the size of the target image according to the zooming-in factor.

8. The method of claim 1, wherein the changing the size of the target image includes:

acquiring an observation distance from the gazed object to an eye of the user;

determining a corresponding zooming-in factor according to the observation distance; and

changing the size of the target image according to the zooming-in factor.

9. The method of claim 8, wherein the acquiring the observation distance includes:

detecting an actual focusing point distance of the eye of the user, and taking the actual focusing point distance as the observation distance from the gazed object to the eye of the user.

10. The method of claim 8, wherein the acquiring the observation distance includes:

tracking a direction of line-of-sight of the eye of the user, acquiring the scene depth of the position where the gazed object is located according to the direction of line-of-sight, and determining the observation distance from the gazed object to the eye of the user according to the scene depth.

11. The method of claim 8, wherein the acquiring the observation distance includes:

tracking directions of line-of-sight of both eyes of the user, and obtaining the observation distance from the gazed object to the eye of the user via an intersection point of the directions of line-of-sight of both eyes of the user.

12. The method of claim 1, further comprising:

presetting a target focusing point distance of the eye of the user, and a buffer zone of the target focusing point distance, wherein the changing the size of the target image includes;

detecting an actual focusing point distance of the eye of the user; and

changing the size of the target image according to the target focusing point distance, the actual focusing point distance, and the buffer zone.

13. The method of claim 12, wherein the changing the size of the target image according to the target focusing point distance, the actual focusing point distance, and the buffer zone includes:

in the case where the actual focusing point distance is smaller than the target focusing point distance and the actual focusing point distance is outside the buffer zone, increasing the actual focusing point distance to the target focusing point distance.

14. The method of claim 12, wherein the changing the size of the target image according to the target focusing point distance, the actual focusing point distance, and the buffer zone includes:

in the case where the actual focusing point distance is greater than the target focusing point distance and the actual focusing point distance is outside the buffer zone, decreasing the actual focusing point distance to the target focusing point distance.

15. The method of claim 12, wherein the buffer zone is zero.

16. The method of claim 9, wherein the detecting the actual focusing point distance of the eye of the user includes:

collecting images presented at the eye fundus of the user;

adjusting an imaging parameter of the optical path between the eye and the collection position, to collect a set of images with a definition greater than a predetermined value;

processing the images to obtain an optical parameter of the eye corresponding to the set of images with the definition greater than the predetermined value; and

obtaining the actual focusing point distance of the eye according to the optical parameter of the eye.

17. The method of claim 16, wherein the processing the images to obtain the optical parameter includes:

analyzing the images to find the set of images; and

determining the optical parameter of the eye according to the set of images and the imaging parameter of the optical path corresponding to the set of images.

18. The method of claim 1, wherein the changing the size of the target image includes:

changing the size of the target image of the gazed object at the eye fundus by optical zoom processing.

19. An imaging device, comprising:

a processor that executes or facilitates execution of executable units to perform operations of the imaging device, the executable units comprising;

an object determination unit configured to determine a gazed object of a user according to an image at an eye fundus of the user; and

a processing unit configured to change a size of a target image of the gazed object at the eye fundus according to a predetermined zooming rule.

20. The imaging device of claim 19, wherein the executable units further comprise:

a control unit configured to activate the processing unit in a case where the user has observed the gazed object for a time period exceeding a predetermined time.

21. The imaging device of claim 19, wherein the executable units further comprise:

a presetting unit configured to preset a target area ratio of the target image, and a buffer zone of the target area ratio, wherein the processing unit comprises;

a calculation subunit configured to calculate an actual area ratio of the target image at the eye fundus; and

an execution subunit configured to change the size of the target image according to the target area ratio, the actual area ratio, and the buffer zone.

22. The imaging device of claim 19, wherein the processing unit comprises:

a calculation subunit configured to calculate an actual area ratio of the target image at the eye fundus;

a factor subunit configured to determine a corresponding zooming-in factor according to the actual area ratio; and

an execution subunit configured to change the size of the target image according to the zooming-in factor.

23. The imaging device of claim 19, wherein the processing unit comprises:

an acquisition subunit configured to acquire an observation distance from the gazed object to an eye of the user;

a factor subunit configured to determine a corresponding zooming-in factor according to the observation distance; and

an execution subunit configured to change the size of the target image according to the zooming-in factor.

24. The imaging device of claim 23, wherein the acquisition subunit comprises:

a focusing point detection module configured to detect an actual focusing point distance of the eye of the user, and taking the actual focusing point distance as the observation distance from the gazed object to the eye of the user.

25. The imaging device of claim 23, wherein the acquisition subunit comprises:

an optical axis tracking module configured to track a direction of line-of-sight of the eye of the user;

a depth acquisition module configured to acquire the scene depth of the position where the gazed object is located according to the direction of line-of-sight; and

a calculation module configured to calculate according to the scene depth to obtain the observation distance from the gazed object to the eye of the user.

26. The imaging device of claim 23, wherein the acquisition subunit comprises:

an optical axis tracking module configured to track directions of line-of-sight of both eyes of the user; and

a distance acquisition module configured to acquire the observation distance from the gazed object to the eye of the user based on an intersection point of the directions of line-of-sight of both eyes of the user.

27. The imaging device of claim 19, wherein the executable units further comprise:

a presetting unit configured to preset a target focusing point distance of an eye of the user, and a buffer zone of the target focusing point distance, wherein the processing unit comprises;

a focusing point detection subunit configured to detect the actual focusing point distance of the eye of the user; and

an execution subunit configured to change the size of the target image according to the target focusing point distance, the actual focusing point distance, and the buffer zone.

28. The imaging device of claim 27, wherein the focusing point detection subunit comprises:

an image collection module configured to collect images presented at the eye fundus;

an adjustment module configured to adjust an imaging parameter of the optical path between the eye and the image collection module, to collect a set of images with a definition greater than a predetermined value;

an image processing module configured to process the images to obtain an optical parameter of the eye corresponding to the set of images with the definition greater than the predetermined value; and

a distance acquisition module configured to obtain the actual focusing point distance of the eye according to the optical parameter of the eye.

29. The imaging device of claim 28, wherein the image processing module comprises:

an image analysis sub-module configured to analyze the images to find the set of images; and

an optical parameter calculation sub-module configured to determine the optical parameters of the eye, according to the set of images and the imaging parameter of the optical path corresponding to the set of images.

30. The imaging device of claim 19, wherein the device is, a pair of glasses.

31. A computer readable storage device, comprising at least one executable instruction, which, in response to execution, causes an imaging device comprising a processor to perform operations, comprising:

determining a gazed object of a user according to an image at an eye fundus of the user; and

changing a size of a target image of the gazed object at the eye fundus according to a predefined zooming rule.

32. An imaging device, comprising a processor and a memory, the memory storing computer executable instructions, the processor being connected to the memory through a communication bus, and when the imaging device operates, the processor executing the computer executable instructions stored in the memory, so that the imaging device executes operations, comprising:

determining a gazed object of a user according to an image at an eye fundus of the user; and

changing a size of a target image of the gazed object at the eye fundus according to a defined zooming rule.