Gesture-based object measurement method and apparatus

• US 10,262,197 B2
• Filed: 11/04/2016
• Issued: 04/16/2019
• Est. Priority Date: 11/17/2015
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Lin, Yimin, Lian, Shiguo
• Primary Examiner(s): Baker, Charlotte M
• Application Number:
  US15/344,218
• Publication Number:
  US 20170140216A1
• Time in Patent Office: 893 Days
• Field of Search: 382103, 382100, 345 8, 345173, 33506, 362 84, 362145
• CPC Class Codes: G01B 11/00 Measuring arrangements characterised by the use of optical techniques
• CPC Class Codes: G01B 11/026 by measuring distance between sensor and object G01B11/0608 takes precedence
• CPC Class Codes: G01B 11/03 by measuring coordinates of points
• CPC Class Codes: G01B 11/24 for measuring contours or curvatures
• CPC Class Codes: G01B 11/285 using photoelectric detection means
• CPC Class Codes: G01B 2210/58 Wireless transmission of information between a sensor or probe and a control or evaluation unit
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

In the field of man-machine interaction technologies, a gesture-based object measurement method and apparatus, which are used to improve measurement efficiency. According to this method, after image information is collected, contour information of a to-be-measured object is automatically extracted and partitioned off, and a measurement parameter value such as a length, an area, or a volume is calculated on this basis. In this way, not only real-time online measurement is implemented, a measurement process is simpler, and more convenient, visual, and effective, and augmented reality (AR) measurement efficiency can be improved, but also the measurement process is more harmonious and natural, and closer to a human intention, and a measurement result is more accurate.

Claims

1. A gesture-based object measurement method, comprising:

collecting image information of a to-be-measured object and a gesture;

extracting contour information of the to-be-measured object from the collected image information;

determining, according to the gesture, a target measurement area that is in the image information and in which the user is interested when the gesture meets a set condition;

partitioning contour information of the target measurement area off the extracted contour information;

obtaining three-dimensional coordinate values obtained after each endpoint comprised in the partitioned-off contour information is mapped to three-dimensional space; and

calculating, according to the obtained three-dimensional coordinate values, a measurement parameter value of the to-be-measured object corresponding to the contour information of the target measurement area.

2. The method according to claim 1, wherein the gesture meets a set condition when a duration during which the gesture is held at a relative position in the image information exceeds a preset duration threshold.

3. The method according to claim 1, wherein the gesture meets a set condition when a distance in which the gesture is translated in a direction perpendicular to a two-dimensional plane to which the image information is mapped exceeds a set step, and a relative position of the gesture remains unchanged in the translation process on the two-dimensional plane to which the image information is mapped.

4. The method according to claim 1, wherein the measurement parameter value comprises at least one of a length value, an area value, a volume value, or a distance to an image information collection device.

5. The method according to claim 1, further comprising:

determining a gesture type of the gesture;

searching a preset correspondence between a gesture type and a measurement parameter for a measurement parameter corresponding to the determined gesture type; and

using the measurement parameter in calculating the measurement parameter value.

6. The method according to claim 1, further comprising displaying the measurement parameter value.

7. A gesture-based object measurement apparatus, comprising:

a display;

a sensor configured to collect image information of a to-be-measured object and a gesture;

a processor coupled to the sensor and configured to;

determine a measurement positioning point of the to-be-measured object according to the gesture when the gesture collected by the sensor meets a set condition;

obtain three-dimensional coordinate values obtained after the measurement positioning point is mapped to three-dimensional space;

determine a measurement parameter of the to-be-measured object; and

calculate a value of the measurement parameter of the to-be-measured object according to the measurement parameter and the three-dimensional coordinate values; and

a transceiver coupled to the processor and configured to send the value of the measurement parameter to the display, the display being configured to display the received parameter value.

8. The apparatus according to claim 7, wherein the processor is further configured to:

determine a gesture type of the gesture;

search a preset correspondence between a gesture type and a measurement parameter for a measurement parameter corresponding to the determined gesture type; and

use the measurement parameter as the measurement parameter of the to-be-measured object.

9. The apparatus according to claim 7, wherein the gesture meets a set condition when a duration during which the gesture is held at a relative position in the image information exceeds a preset duration threshold.

10. The apparatus according to claim 7, further comprising a memory configured to store the programs executed by the processor.

11. The apparatus according to claim 7, wherein the measurement parameter value comprises at least one of a length value, an area value, a volume value, or a distance to an image information collection device.

12. The apparatus according to claim 7, wherein the gesture meets a set condition when a distance in which the gesture is translated in a direction perpendicular to a two-dimensional plane to which the image information is mapped exceeds a set step, and a relative position of the gesture remains unchanged in the translation process on the two-dimensional plane to which the image information is mapped.

13. The apparatus according to claim 7, further comprising a wearable device comprising the display and the sensor.

14. A gesture-based object measurement apparatus, comprising:

a display;

a sensor configured to;

collect image information of a to-be-measured object and a gesture,

a processor coupled to the sensor and configured to;

extract contour information of the to-be-measured object from the image information collected by the sensor;

determine, according to the gesture, a target measurement area that is in the image information and in which the user is interested when the gesture collected by the sensor meets a set condition;

partition contour information of the target measurement area off the extracted contour information;

obtain three-dimensional coordinate values obtained after each endpoint comprised in the partitioned-off contour information is mapped to three-dimensional space; and

calculate, according to the obtained three-dimensional coordinate values, a measurement parameter value of the to-be-measured object corresponding to the contour information of the target measurement area; and

a transceiver coupled to the processor and configured to send the measurement parameter value to the display, the display being configured to display the received measurement parameter value.

15. The apparatus according to claim 14, wherein the gesture meets a set condition when a duration during which the gesture is held at a relative position in the image information exceeds a preset duration threshold.

16. The apparatus according to claim 14, wherein the gesture meets a set condition when a distance in which the gesture is translated in a direction perpendicular to a two-dimensional plane to which the image information is mapped exceeds a set step, and a relative position of the gesture remains unchanged in the translation process on the two-dimensional plane to which the image information is mapped.

17. The apparatus according to claim 14, further comprising a memory, configured to store the programs executed by the processor.

18. The apparatus according to claim 14, wherein the gesture meets a set condition when a duration during which the gesture is held at a relative position in the image information exceeds a preset duration threshold.

19. The apparatus according to claim 14, wherein the measurement parameter value comprises at least one of a length value, an area value, a volume value, or a distance to an image information collection device.

20. The apparatus according to claim 14, further comprising a wearable device comprising the display and the sensor.