FOCUSING METHODS AND APPARATUSES, AND PHOTOGRAPHING DEVICES

• US 20180084186A1
• Filed: 03/04/2016
• Published: 03/22/2018
• Est. Priority Date: 03/24/2015
• Status: Active Grant

• Current Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Original Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Inventors: DU, LIN
• Granted Patent: US 10,447,913 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 7/38 measured at different points on the optical axis , e.g. focussing on two or more planes and comparing image data
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 23/675 comprising setting of focusing regions

Abstract

The present application discloses various focusing methods and apparatuses, and various photographing devices. The focusing method includes: controlling deformation of an image sensor so that reference points of at least two imaging sub-areas of the image sensor after the deformation form a first relative position relationship in a staggered arrangement along a depth direction; acquiring contrast data of a sampling image of an object in the at least two imaging sub-areas; and determining and/or adjusting, according to at least the first relative position relationship and the contrast data, a focusing state of the image sensor. The present application can improve a speed and/or accuracy for determining and/or adjusting the focusing state of the image sensor.

Claims

1. A focusing method, comprising:

controlling deformation of an image sensor so that reference points of at least two imaging sub-areas of the image sensor after the deformation form a first relative position relationship in a staggered arrangement along a depth direction;

acquiring contrast data of a sampling image of an object in the at least two imaging sub-areas; and

determining and/or adjusting, according to at least the first relative position relationship and the contrast data, a focusing state of the image sensor.

2. The method of claim 1, wherein the determining and/or adjusting, according to at least the first relative position relationship and the contrast data, a focusing state of the image sensor comprises:

determining, according to at least the first relative position relationship and the contrast data, second relative position information, which is in the depth direction, depth scopes that correspond to the at least two imaging areas relative to a target in focus depth position that corresponds to the object; and

determining and/or adjusting, according to at least the second relative position information, the focusing state of the image sensor.

3. The method of claim 2, wherein the determining, according to at least the first relative position relationship and the contrast data, second relative position information, which is in the depth direction, of depth scopes that correspond to the at least two imaging areas relative to a target in focus depth position that corresponds to the object comprises:

determining, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a unidirectional change trend, that the target in focus depth position is out of the depth scopes corresponding to the at least two imaging sub-areas.

4. The method of claim 3, wherein the determining, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a unidirectional change trend, that the target in focus depth position is out of the depth scopes corresponding to the at least two imaging sub-areas comprises:

determining, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a first unidirectional change trend matching the first relative position relationship, that the target in focus depth position is at a depth position behind the depth scopes corresponding to the at least two imaging sub-areas.

5. The method of claim 3, wherein the determining, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a unidirectional change trend, that the target in focus depth position is out of the depth scopes corresponding to the at least two imaging sub-areas comprises:

determining, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a second unidirectional change trend opposite to the first relative position relationship, that the target in focus depth position is at a depth position in front of the depth scopes corresponding to the at least two imaging sub-areas.

6. The method of claim 2, wherein the determining, according to at least the first relative position relationship and the contrast data, second relative position information, which is in the depth direction, of depth scopes that correspond to the at least two imaging areas relative to a target in focus depth position that corresponds to the object comprises:

determining, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a non-unidirectional change trend, that the target in focus depth position is between the depth scopes corresponding to the at least two imaging sub-areas.

7. The method of claim 2, wherein the adjusting, according to at least the second relative position information, the focusing state of the image sensor comprises:

adjusting, according to at least the second relative position information, focusing parameters of a photographing device comprising the image sensor so that an imaging plane position of the image sensor approaches or coincides with the target in focus depth position after the focusing parameters are adjusted.

8. The method of claim 1, wherein before the controlling deformation of the image sensor, the method further comprises:

determining a deformation degree of the image sensor, wherein maximum deformation along the depth direction of the at least two imaging sub-areas corresponding to an initial adjustment phase of an adjustment process of the focusing state is greater than the maximum deformation along the depth direction of the at least two imaging sub-areas corresponding to other phases of the adjustment process of the focusing state.

9. The method of claim 8, wherein from the initial adjustment phase of the adjustment process of the focusing state to a convergence phase, the maximum deformation along the depth direction of the at least two imaging sub-areas corresponding to the phases progressively decreases in sequence.

10. The method of claim 1, wherein before the controlling deformation of the image sensor, the method further comprises:

determining, according to a preview image of the object, a focus area; and

determining, according the focus area, the at least two imaging sub-areas, wherein the at least two imaging sub-areas respectively correspond to at least two focus sub-areas comprised in the focus area.

11. The method of claim 10, wherein the determining, according to the focus area, the at least two imaging sub-areas comprises:

determining, according to content of the focus area, a quantity of the imaging sub-areas.

12. The method of claim 11, wherein the quantity of the imaging sub-areas corresponding to the focus area whose content has more details is greater than the quantity of the imaging sub-areas corresponding to the focus area whose content has fewer details.

13. A focusing apparatus, comprising:

a deformation control module, configured to control deformation of an image sensor so that reference points of at least two imaging sub-areas of the image sensor after deformation form a first relative position relationship in a staggered arrangement along a depth direction;

a contrast data acquiring module, configured to acquire contrast data of a sampling image of an object in the at least two imaging sub-areas; and

a processing module, configured to determine and/or adjust, according to at least the first relative position relationship and the contrast data, a focusing state of the image sensor.

14. The apparatus of claim 13, wherein the processing module comprises:

a position information determining sub-module, configured to determine, according to at least the first relative position relationship and the contrast data, second relative position information, which is in the depth direction, of depth scopes that correspond to the at least two imaging areas relative to a target in focus depth position that corresponds to the object; and

a processing sub-module, configured to determine and/or adjust, according to at least the second relative position information, the focusing state of the image sensor.

15. The apparatus of claim 14, wherein the position information determining sub-module comprises:

a first position information determining unit, configured to determine, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a unidirectional change trend, that the target in focus depth position is out of the depth scopes corresponding to the at least two imaging sub-areas.

16. The apparatus of claim 15, wherein the first position information determining unit comprises:

a first position information determining sub-unit, configured to determine, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a first unidirectional change trend matching the first relative position relationship, that the target in focus depth position is at a depth position behind the depth scopes corresponding to the at least two imaging sub-areas.

17. The apparatus of claim 15, wherein the first position information determining unit comprises:

a second position information determining sub-unit, configured to determine, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a second unidirectional change trend opposite to the first relative position relationship, that the target in focus depth position is at a depth position in front of the depth scopes corresponding to the at least two imaging sub-areas.

18. The apparatus according to claim 14, wherein the position information determining sub-module comprises:

a second position information determining unit, configured to determine, in response to that the contrast data corresponding to the at least two imaging sub-areas presents a non-unidirectional change trend, that the target in focus depth position is between the depth scopes corresponding to the at least two imaging sub-areas.

19. The apparatus of claim 14, wherein the processing sub-module comprises:

a focus adjusting unit, configured to adjust, according to at least the second relative position information, focusing parameters of a photographing device comprising the image sensor so that an imaging plane position of the image sensor approaches or coincides with the target in focus depth position after the focusing parameters are adjusted.

20. The apparatus of claim 14, further comprising:

a deformation degree control module, configured to determine a deformation degree of the image sensor, wherein maximum deformation along the depth direction of the at least two imaging sub-areas corresponding to an initial adjustment phase of an adjustment process of the focusing state is greater than the maximum deformation along the depth direction of the at least two imaging sub-areas corresponding to other phases of the adjustment process of the focusing state.

21. The apparatus of claim 20, wherein from the initial adjustment phase of the adjustment process of the focusing state to a convergence phase, the maximum deformation along the depth direction of the at least two imaging sub-areas corresponding to the phases progressively decreases in sequence.

22. The apparatus of claim 13, further comprising:

a focus area determining module, configured to determine, according to a preview image of the object, a focus area; and

an imaging sub-area determining module, configured to determine, according the focus area, the at least two imaging sub-areas, wherein the at least two imaging sub-areas respectively correspond to at least two focus sub-areas comprised in the focus area.

23. The apparatus of claim 22, wherein the imaging sub-area determining module comprises:

an imaging sub-area determining sub-module, configured to determine, according content of the focus area, a quantity of the imaging sub-areas.

24. The apparatus of claim 23, wherein the quantity of the imaging sub-areas corresponding to the focus area whose content has more details is greater than the quantity of the imaging sub-areas corresponding to the focus area whose content has fewer details.

25. A photographing device, comprising:

a photographing optical system, a deformable image sensor, and a focusing apparatus according to claim 13.

26. The photographing device of claim 25, wherein the image sensor comprises a flexible image sensor.

27. The photographing device of claim 25, wherein the image sensor comprises multiple imaging sub-areas in an array distribution, and the at least two imaging sub-areas is connected by a deformable connection component.

28. A computer readable storage apparatus, comprising at least one executable instruction, which, in response to execution by a processor of a photographing device, causes the photographing device to perform a focusing method, comprising:

controlling deformation of an image sensor so that reference points of at least two imaging sub-areas of the image sensor after the deformation form a first relative position relationship in a staggered arrangement along a depth direction;

acquiring contrast data of a sampling image of an object in the at least two imaging sub-areas; and

determining and/or adjusting, according to at least the first relative position relationship and the contrast data, a focusing state of the image sensor.

29. A focusing apparatus, characterized by comprising a processor and a memory, the memory storing computer executable instructions, the processor being connected to the memory through a communication bus, and when the apparatus for controlling task migration operates, the processor executing the computer executable instructions stored in the memory, causing the apparatus for controlling task migration to execute operations, comprising:

controlling deformation of an image sensor so that reference points of at least two imaging sub-areas of the image sensor after the deformation form a first relative position relationship in a staggered arrangement along a depth direction;

acquiring contrast data of a sampling image of an object in the at least two imaging sub-areas; and

determining and/or adjusting, according to at least the first relative position relationship and the contrast data, a focusing state of the image sensor.