System and method of gesture detection for a remote device

• US 10,466,772 B2
• Filed: 01/09/2017
• Issued: 11/05/2019
• Est. Priority Date: 01/09/2017
• Status: Active Grant

• Current Assignee: Infineon Technologies AG
• Original Assignee: Infineon Technologies AG
• Inventors: Trotta, Saverio
• Primary Examiner(s): Hong, Richard J
• Application Number:
  US15/401,598
• Publication Number:
  US 20180196501A1
• Time in Patent Office: 1,030 Days
• CPC Class Codes: B60R 16/037 for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: B60R 2325/205 Mobile phones
• CPC Class Codes: B60R 25/01 operating on vehicle systems or fittings, e.g. on doors, seats or windscreens
• CPC Class Codes: B60R 25/2045 by hand gestures
• CPC Class Codes: B60R 25/245 where the antenna reception area plays a role
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04W 12/50 Secure pairing of devices
• CPC Class Codes: H04W 4/70 Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Abstract

A method for operating a mobile device includes detecting a gesture by the mobile device. Detecting the gesture includes receiving a reflected millimeter wave signal by the mobile device, generating a first message in accordance with the detected gesture, and transmitting the first message from the mobile device to an external remote device. The detected gesture is associated with an operation of the remote device.

Claims

1. A method for operating a wireless vehicle access key, the method comprising:

detecting a gesture by the wireless vehicle access key, wherein the wireless vehicle access key is configured to unlock a vehicle and detecting the gesture comprises

transmitting, by a first transmitter of the wireless vehicle access key, a first millimeter wave signal to a location of the gesture, and

receiving a reflected millimeter wave signal by the wireless vehicle access key, wherein the reflected millimeter wave signal comprises a reflection of the first millimeter wave signal reflected from the location of the gesture;

generating a first message in accordance with the detected gesture, wherein the first message comprises radar data based on the received reflected millimeter wave signal; and

wirelessly transmitting the first message from the wireless vehicle access key to the vehicle using a second transmitter different from the first transmitter,

wherein the detected gesture is associated with an operation of the vehicle.

2. The method of claim 1, wherein:

the gesture is located a distance of not greater than 30 centimeters from the wireless vehicle access key.

3. The method of claim 1, further comprising:

wirelessly charging a battery of the wireless vehicle access key, by the wireless vehicle access key, from a power source of the vehicle.

4. The method of claim 1, wherein:

the operation comprises at least one of setting an air conditioning setting of the vehicle, setting a heat seating setting of the vehicle, opening a trunk of the vehicle, setting a lighting setting of the vehicle, or initiating an emergency call.

5. The method of claim 1, wherein:

the gesture comprises a hand gesture.

6. The method of claim 1, wherein detecting the gesture further comprises:

determining frequency content of the reflected millimeter wave signal;

tracking the frequency content of the reflected millimeter wave signal over time; and

comparing the tracked frequency content to a pre-determined gesture signature stored in a look-up table.

7. The method of claim 1, wherein:

the wireless vehicle access key further comprises a first antenna and a second antenna;

receiving the reflected millimeter wave signal comprises receiving using the first antenna; and

transmitting the first message comprises transmitting using the second antenna.

8. The method of claim 7, wherein:

the first antenna comprises a receive antenna array and a transmit antenna array.

9. The method of claim 1, wherein:

transmitting the first message comprises encrypting, by the wireless vehicle access key, the first message using a shared security key of the wireless vehicle access key and the vehicle.

10. The method of claim 1, further comprising:

receiving feedback, by the wireless vehicle access key from the vehicle, wherein the feedback comprises a status of whether the vehicle successfully performed the operation associated with the gesture.

11. The method of claim 10, further comprising:

generating, by the wireless vehicle access key, a sound in accordance with the received feedback.

12. The method of claim 11, wherein:

the operation comprises adjusting a temperature setting; and

the received feedback comprises a variable feedback signal that varies in accordance with the adjusted temperature setting; and

generating the sound comprises adjusting the sound in accordance with the variable feedback signal.

13. The method of claim 1, wherein the first message comprises at least one of radar timing information or radar frequency information.

14. A method for operating a vehicle, the method comprising:

wirelessly receiving, by the vehicle from a wireless vehicle access key, a first message using a first wireless protocol, wherein the first message comprises radar data generated using a millimeter wave radar system of the wireless vehicle access key, wherein the first wireless protocol operates using signals different from radar signals of the millimeter wave radar system of the wireless vehicle access key;

processing, by the vehicle, the first message to detect a gesture associated with an operation of the vehicle; and

performing, by the vehicle, the operation in accordance with the detected gesture.

15. The method of claim 14, further comprising:

decrypting the first message, by the vehicle, in accordance with a shared security key of the wireless vehicle access key and the vehicle.

16. The method of claim 14, further comprising:

wirelessly charging the wireless vehicle access key by a power source disposed within the vehicle.

17. The method of claim 14, wherein:

processing the first message comprises;

performing a spectral analysis of the radar data;

tracking frequency content of the radar data over time based on the spectral analysis; and

matching the tracked frequency content with a pre-determined gesture signature stored in a look-up table.

18. The method of claim 14, further comprising:

generating feedback comprising a status of whether the vehicle successfully performed the operation associated with the gesture; and

transmitting the feedback from the vehicle to the wireless vehicle access key.

19. The method of claim 18, wherein:

performing the operation comprises adjusting a temperature setting; and

the feedback comprises a variable feedback signal that varies in accordance with the adjusted temperature setting.

20. The method of claim 14, wherein performing the operation comprises initiating an emergency call.

21. The method of claim 20, further comprising:

receiving, by the vehicle, a user input comprising emergency contact information,

wherein initiating the emergency call is in accordance with the emergency contact information.

22. The method of claim 14, further comprising:

receiving, by the vehicle, user input comprising a desired operation of the vehicle to be associated with a desired gesture; and

associating the desired operation with the desired gesture.

23. A control circuit for a vehicle, the circuit comprising:

a wireless receiver configured to receive, from a wireless vehicle access key, a first message using a first wireless protocol, wherein the first message comprises radar data generated using a millimeter wave radar system of the wireless vehicle access key, wherein the first wireless protocol operates using signals different from radar signals of the millimeter wave radar system of the wireless vehicle access key;

a processor coupled to the wireless receiver;

a non-transitory computer readable medium storing programming for execution by the processor, the programming comprising instructions to;

process the first message to detect a gesture associated with an operation of the vehicle; and

perform the operation of the vehicle in accordance with the detected gesture.

24. The circuit of claim 23, further comprising a look-up table (LUT), wherein:

the first message comprises radar data; and

the instructions to process the first message comprise instructions to;

perform a spectral analysis of the radar data;

track frequency content of the radar data over time based on the spectral analysis; and

match the tracked frequency content with a pre-determined gesture signature stored in the LUT.

25. The circuit of claim 23, wherein the operation comprises at least one of:

turning on the vehicle turning off the vehicle setting a temperature setting, setting a fan setting, turning on a sound system, turning off the sound system, setting a volume setting of the sound system, selecting an input of the sound system, tuning a radio channel, opening a mechanical latch, turning on a light, turning off the light, setting a dimming setting of the light, changing a color of the light, turning on a user display, turning off the user display, changing visible content of the user display, setting a cruise control setting, turning on an auto-pilot program, turning off the auto-pilot program, turning on a voice recognition program, turning off the voice recognition program, mapping a route, looking up weather information, looking up information about a road condition, looking up information about traffic, initiating a diagnostic test, enabling a security system, disabling the security system, generating a sound, generating a haptic output, and initiating a communications session.