HANDHELD DEVICE, OBJECT POSITIONING METHOD AND COMPUTER-READABLE RECORDING MEDIUM

• US 20160377712A1
• Filed: 06/24/2015
• Published: 12/29/2016
• Est. Priority Date: 06/24/2015
• Status: Active Grant

• Current Assignee: HTC Corporation
• Original Assignee: HTC Corporation
• Inventors: Wu, Chun-Yih, Pu, Ta-Chun, Kuo, Yen-Liang
• Granted Patent: US 9,778,353 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01S 13/10 using transmission of interrupted, pulse modulated waves determination of distance by phase measurement G01S13/32
• CPC Class Codes: G01S 13/867 Combination of radar systems with cameras
• CPC Class Codes: G01S 7/411 Identification of targets based on measurements of radar reflectivity G01S7/415 takes precedence

Abstract

A handheld device, an object positioning method thereof and a computer-readable recording medium are provided. The handheld device includes a radar sensor, an image sensor and a control unit. The radar sensor emits a detection wave, and receives a reflected wave generated by an object by reflecting the detection wave. Each object generates one of the reflected waves. The image sensor captures an image. The image includes a subset of the objects. The control unit extracts a waveform signature of each reflected wave, recognizes the waveform signature in a time domain and a frequency domain to determine a first type of each object, obtains a first position of the object according to the reflected wave, obtains a second type and a second position of each object according to the first image, and performs object mapping to combine or compare the first position and the second position of the object.

Claims

1. A handheld device, comprising:

a radar sensor, emitting a first detection wave, and receiving at least one reflected wave generated by at least one object by reflecting the first detection wave, wherein each of the at least one object generates one of the at least one reflected wave;

an image sensor, capturing a first image, wherein the first image comprises a subset of the at least one object; and

a control unit, coupled to the radar sensor and the image sensor, extracting a waveform signature of each of the at least one reflected wave, respectively recognizing the waveform signature in a time domain and a frequency domain to determine a first type of each of the at least one object, obtaining a first position of each of the at least one object according to the at least one reflected wave, obtaining a second type and a second position of each of the at least one object according to the first image, and performing a mapping operation based on the first type, the second type, the first position and the second position of each of the at least one object to combine or compare the first position and the second position.

2. The handheld device as claimed in claim 1, wherein the control unit extracts an image signature of each of the at least one object in the first image, and identifies the image signature to determine the second type of each of the at least one object.

3. The handheld device as claimed in claim 1, wherein the first position of each of the at least one object is a depth calculated according to a time of arrival of the at least one reflected wave of the at least one object, and the second position of each of the at least one object is an azimuth of the at least one object determined according to whether the at least one object is in the first image, and the control unit performs the mapping operation to combine the depth and the azimuth of each of the at least one object.

4. The handheld device as claimed in claim 3, wherein the control unit controls the radar sensor to emit a second detection wave to detect a physiologic motion of the at least one object when both of the first type and the second type of the at least one object are a specific type and the depth and the azimuth of the at least one object are all in a specific range.

5. The handheld device as claimed in claim 4, wherein the first detection wave comprises a plurality of pulses, and the second detection wave comprises a plurality of pulses;

wherein a pulse interval of the first detection wave is greater than a pulse interval of the second detection wave.

6. The handheld device as claimed in claim 1, wherein the first position of each of the at least one object is a depth calculated according to a time of arrival of the at least one reflected wave of the at least one object, the first image comprises a plurality of regions, each of the regions corresponds to an azimuth, and the second position of each of the at least one object is the azimuth corresponding to the region comprising the at least one object in the regions, and the control unit performs the mapping operation to combine the depth and the azimuth of each of the at least one object.

7. The handheld device as claimed in claim 1, wherein the first position of each of the at least one object is a first depth calculated according to a time of arrival of the at least one reflected wave of the at least one object, the image sensor further captures a second image, both of the first image and the second image comprise the at least one object, the second position of each of the at least one object is a second depth of the at least one object calculated according to an image signature of the at least one object in the first image and the second image, and the control unit performs the mapping operation to compare the first depth and the second depth of the at least one object.

8. The handheld device as claimed in claim 7, wherein when the first depth and the second depth of the at least one object are consistent, the control unit generates depth information of the at least one object according to the first depth and the second depth.

9. The handheld device as claimed in claim 7, wherein when the first depth and the second depth of the at least one object are not consistent, the control unit neglects the image signature corresponding to the inconsistent depth, recalculates the second depth, and re-performs the mapping operation.

10. The handheld device as claimed in claim 7, wherein when the first depth and the second depth of the at least one object are not consistent, the control unit reselects the image signature of the at least one object corresponding to the inconsistent depth, recalculates the second depth, and re-performs the mapping operation.

11. An object positioning method, comprising:

emitting a first detection wave, and receiving at least one reflected wave generated by at least one object by reflecting the first detection wave, wherein each of the at least one object generates one of the at least one reflected wave;

capturing a first image, wherein the first image comprises a subset of the at least one object;

extracting a waveform signature of each of the at least one reflected wave, and respectively recognizing the waveform signature in a time domain and a frequency domain to determine a first type of each of the at least one object;

obtaining a first position of each of the at least one object according to the at least one reflected wave;

obtaining a second type and a second position of each of the at least one object according to the first image; and

performing a mapping operation based on the first type, the second type, the first position and the second position of each of the at least one object to combine or compare the first position and the second position.

12. The object positioning method as claimed in claim 11, further comprising:

extracting an image signature of each of the at least one object in the first image, and identifying the image signature to determine the second type of each of the at least one object.

13. The object positioning method as claimed in claim 11, wherein the first position of each of the at least one object is a depth calculated according to a time of arrival of the at least one reflected wave of the at least one object, and the second position of each of the at least one object is an azimuth of the at least one object determined according to whether the at least one object is in the first image, and the mapping operation is performed to combine the depth and the azimuth of each of the at least one object.

14. The object positioning method as claimed in claim 13, further comprising:

emitting a second detection wave to detect a physiologic motion of the at least one object when both of the first type and the second type of the at least one object are a specific type, and the depth and the azimuth of the at least one object are all in a specific range.

15. The object positioning method as claimed in claim 14, wherein the first detection wave comprises a plurality of pulses, and the second detection wave comprises a plurality of pulses;

wherein a pulse interval of the first detection wave is greater than a pulse interval of the second detection wave.

16. The object positioning method as claimed in claim 11, wherein the first position of each of the at least one object is a depth calculated according to a time of arrival of the at least one reflected wave of the at least one object, the first image comprises a plurality of regions, each of the regions corresponds to an azimuth, and the second position of each of the at least one object is the azimuth corresponding to the region comprising the at least one object in the regions, and the mapping operation is performed to combine the depth and the azimuth of each of the at least one object.

17. The object positioning method as claimed in claim 11, wherein the first position of each of the at least one object is a first depth calculated according to a time of arrival of the at least one reflected wave of the at least one object, and the object positioning method further comprising:

capturing a second image, wherein both of the first image and the second image comprise the at least one object, the second position of each of the at least one object is a second depth of the at least one object calculated according to an image signature of the at least one object in the first image and the second image, and the mapping operation is performed to compare the first depth and the second depth of the at least one object.

18. The object positioning method as claimed in claim 17, further comprising:

when the first depth and the second depth of the at least one object are consistent, generating depth information of the at least one object according to the first depth and the second depth.

19. The object positioning method as claimed in claim 17, further comprising:

when the first depth and the second depth of the at least one object are not consistent, neglecting the image signature corresponding to the inconsistent depth, recalculating the second depth, and re-performing the mapping operation.

20. The object positioning method as claimed in claim 17, further comprising:

when the first depth and the second depth of the at least one object are not consistent, reselecting the image signature of the at least one object corresponding to the inconsistent depth, recalculating the second depth, and re-performing the mapping operation.

21. A non-transitory computer-readable recording medium, storing a computer program, wherein after a handheld device loads and executes the computer program, the object positioning method as claimed in claim 11 is implemented.