Method of prompting proper rotation angle for image depth establishing

• US 10,148,929 B2
• Filed: 04/15/2014
• Issued: 12/04/2018
• Est. Priority Date: 04/15/2013
• Status: Active Grant

• Current Assignee: HTC Corporation
• Original Assignee: HTC Corporation
• Inventors: Huang, Liang-Kang, Lee, Yu-Ting, Kuo, Tzu-Hao, Huang, Chun-Hsiang
• Primary Examiner(s): Hallenbeck-Huber, Jeremiah C
• Assistant Examiner(s): Shahnami, Amir
• Application Number:
  US14/252,791
• Publication Number:
  US 20140307053A1
• Time in Patent Office: 1,694 Days
• Field of Search: 348 46
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects

Abstract

An electronic apparatus includes a motion sensor, an image capturing unit, a display unit and a processing unit. A controlling method for the electronic apparatus includes following steps. An initial orientation of the electronic apparatus is obtained by the motion sensor when a first image is captured by the electronic apparatus. A predetermined rotation angle relative to the initial orientation is assigned. A rotation prompt indicating the predetermined rotation angle is displayed via the display unit.

Claims

1. A controlling method, suitable for an electronic apparatus comprising a motion sensor and a display unit, the controlling method comprising:

obtaining an initial orientation of the electronic apparatus by the motion sensor, when a first image is captured by the electronic apparatus;

calculating a rotation angle relative to the initial orientation for calculating depth information; and

displaying a rotation prompt indicating the rotation angle via the display unit, wherein the display unit comprises an user interface;

wherein the step of calculating the rotation angle comprises;

extracting a target object from the first image;

generating an estimated depth value according to the target object; and

calculating the rotation angle according to the estimated depth value,

wherein when the estimated depth value equals to a first value, the electronic apparatus assigns the rotation angle to be a first angular degree, and

when the estimated depth value equals to a second value smaller than the first value, the electronic apparatus assigns the rotation angle to be a second angular degree smaller than the first angular degree;

wherein the step of displaying the rotation prompt comprises;

displaying a first prompt frame on the user interface, the first prompt frame corresponding to the initial orientation on the user interface, wherein the first prompt frame comprises a symbol;

displaying a second prompt frame on the user interface, the second prompt frame being spaced apart horizontally from the first prompt frame by a gap, the pap corresponding to the rotation angle, wherein the second prompt frame is positioned corresponding to a rotation target and comprises a symbol; and

displaying a track pattern on the user interface between the first prompt frame and the second prompt frame wherein the track pattern indicates a direction that the electronic apparatus must be rotated to realize rotation of the electronic apparatus by the rotation angle;

wherein the first prompt frame is moved on the user interface as the electronic apparatus is rotated and overlaps the second prompt frame when the electronic apparatus has been rotated by the rotation angle.

2. The controlling method of claim 1, further comprising:

sensing a current rotation angle of the electronic apparatus relative to the initial orientation by the motion sensor;

capturing a second image by the electronic apparatus when the current rotation angle matches the rotation angle; and

establishing depth information by comparing the first image and the second image according to the rotation angle.

3. The controlling method of claim 1, further comprising:

sensing a current level bias relative to a horizon line by the motion sensor; and

displaying a level prompt indicating the current level bias relative to the horizon line via the display unit.

13. The controlling method of claim 1, wherein the second prompt frame is positioned at the center of the user interface when the electronic apparatus has been rotated by the rotation angle.

4. A controlling method, suitable for an electronic apparatus comprising a motion sensor and a display unit, the controlling method comprising:

obtaining an initial orientation of the electronic apparatus by the motion sensor, when a first image is captured by the electronic apparatus;

calculating a plurality of rotation angles relative to the initial orientation; and

displaying a rotation prompt via the display unit, wherein the display unit comprises an user interface;

wherein when a distance existed between the electronic apparatus and the target object equals to a first value, the electronic apparatus assigns the rotation angle to be a first angular degree, and

when the distance existed between the electronic apparatus and the target object equals to a second value smaller than the first value, the electronic apparatus assigns the rotation angle to be a second angular degree smaller than the first angular degree;

wherein the rotation prompt comprises a first prompt frame, a plurality of second prompt frames, and a track pattern, each of the plurality of second prompt frames indicating one of the rotation angles, and the step of displaying the rotation prompt comprises;

displaying the first prompt frame on the user interface, the first prompt frame corresponding to the initial orientation on the user interface, wherein the first prompt frame comprises a symbol;

displaying the plurality of second prompt frames on the user interface, each of the plurality of second prompt frames being spaced apart horizontally from the first prompt frame by a gap, the gap corresponding to one of the plurality of rotation angles, wherein each of the plurality of second prompt frames is positioned corresponding to a rotation target and comprises a symbol; and

displaying the track pattern on the user interface between the first prompt frame and the plurality of second prompt frames, wherein the track pattern indicates a direction that the electronic apparatus must be rotated to realize rotation of the electronic apparatus by one of the plurality of rotation angles;

wherein the first prompt frame is moved on the user interface as the electronic apparatus is rotated, and overlaps with one of the plurality of second prompt frames when the electronic apparatus has been rotated by one of the plurality of rotation angles.

5. The controlling method of claim 4, further comprising:

sensing a current rotation angle and a current orientation of the electronic apparatus relative to the initial orientation by the motion sensor;

capturing a second image by the electronic apparatus when the current rotation angle matches one of the rotation angles and the first prompt frame overlaps with one of the plurality of second prompt frames; and

establishing depth information by comparing the first image and the second image according to the matched one of the rotation angles.

6. The controlling method of claim 4, further comprising:

sensing a current level bias relative to a horizon line by the motion sensor; and

displaying a level prompt indicating the current level bias relative to the horizon line via the display unit.

7. An electronic apparatus, comprising:

a motion sensor, for sensing an orientation of the electronic apparatus;

an image capturing unit;

a display unit, for displaying a user interface; and

a processor, coupled with the motion sensor, the image capturing unit and the display unit,

wherein, when the image capturing unit captures a first image, the motion sensor is configured for obtaining an initial orientation of the electronic apparatus, the processor is configured for generating at least one rotation angle relative to the initial orientation, and the display unit is configured for displaying a rotation prompt indicating the at least one rotation angle on the user interface;

wherein the processor generates an estimated depth value according to a target object extracted from the first image and calculates the rotation angle according to the estimated depth value,

when the estimated depth value equals to a first value, the electronic apparatus assigns the rotation angle to be a first angular degree, and

when the estimated depth value equals to a second value smaller than the first value, the electronic apparatus assigns the rotation angle to be a second angular degree smaller than the first angular degree;

wherein the rotation prompt comprises;

a first prompt frame, wherein the first prompt frame is corresponding to the initial orientation on the user interface, and the first prompt frame comprises a symbol;

a second prompt frame, wherein the second prompt frame is being spaced apart horizontally from the first prompt frame by a gap, the gap is corresponding to the rotation angle, and the second prompt frame is positioned corresponding to a rotation target and comprises a symbol; and

a track pattern provided between the first prompt frame and the second prompt frame, wherein the track pattern indicates a direction that the electronic apparatus must be rotated to realize rotation of the electronic apparatus by the rotation angle;

wherein the first prompt frame is moved on the user interface as the electronic apparatus is rotated, and overlaps the second prompt frame when the electronic apparatus has been rotated by the rotation angle.

8. The electronic apparatus of claim 7, wherein the motion sensor is further configured for sensing a current rotation angle of the electronic apparatus relative to the initial orientation, when the current rotation angle matches the rotation angle, the image capturing unit captures a second image, and the processor establishes depth information by comparing the first image and the second image according to the rotation angle.

9. The electronic apparatus of claim 7, wherein the motion sensor is further configured for sensing a current level bias relative to a horizon line, and the display unit is further configured for displaying a level prompt indicating the current level bias relative to the horizon line on the user interface.

10. The electronic apparatus of claim 7, wherein the processor is configured for assigning a plurality of rotation angles relative to the initial orientation in correspondence with different distances existed between the electronic apparatus and a target object within the first image.

11. The electronic apparatus of claim 10, wherein the rotation prompt comprises a plurality of second prompt frames, and each of the plurality of second prompt frames indicating one of the rotation angles.

12. The electronic apparatus of claim 11, wherein the motion sensor is further configured for sensing a current rotation angle of the electronic apparatus relative to the initial orientation, when the current rotation angle matches one of the rotation angles and the first prompt frame overlaps with one of the plurality of second prompt frames, the image capturing unit captures a second image, and the processor establishes depth information by comparing the first image and the second image according to the matched one of the rotation angles.

14. A controlling method, suitable for an electronic apparatus comprising a motion sensor and a display unit, wherein the display unit comprises an user interface, the controlling method comprising:

displaying a first target frame on the user interface before the first image is captured, wherein the first target frame is a symbol and prompts a user to place a target object at the first target frame;

obtaining an initial orientation of the electronic apparatus by the motion sensor, when the first image is captured by the electronic apparatus;

calculating a rotation angle relative to the initial orientation for calculating depth information; and

displaying a rotation prompt indicating the rotation angle via the display unit;

wherein the step of calculating the rotation angle comprises;

extracting the target object from the first image;

generating an estimated depth value according to the target object; and

calculating the rotation angle according to the estimated depth value;

wherein when the estimated depth value equals to a first value, the electronic apparatus assigns the rotation angle to be a first angular degree, and

when the estimated depth value equals to a second value smaller than the first value, the electronic apparatus assigns the rotation angle to be a second angular degree smaller than the first angular degree;

wherein the step of displaying a rotation prompt comprises, after the first image is captured;

displaying a second target frame on the user interface, the second target frame being spaced apart horizontally from the first target frame by a gap, the gap corresponding to the rotation angle; and

displaying a track pattern on the user interface between the first target frame and the second target frame, wherein the track pattern indicates a direction that the electronic apparatus must be rotated to realize the rotation angle;

wherein the second target frame prompts the user to rotate the electronic apparatus to place the target object at the second target frame, the target object being located at the second target frame when electronic apparatus has been rotated by the rotation angle.

15. The controlling method of claim 14, wherein the first target frame is located in a first portion of the display unit, the second target frame is located in a second portion of the display unit, and the first portion and the second portion are located on opposite halves of the display unit.