Methods and systems for opening of a vehicle access point using audio or video data associated with a user

• US 10,151,136 B2
• Filed: 09/18/2017
• Issued: 12/11/2018
• Est. Priority Date: 02/17/2016
• Status: Active Grant

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Myers, Scott Vincent, Nallapa, Venkatapathi Raju, Gurghian, Alexandru Mihai
• Primary Examiner(s): Rushing, Mark
• Application Number:
  US15/707,668
• Publication Number:
  US 20180002972A1
• Time in Patent Office: 449 Days
• Field of Search: 34042615
• CPC Class Codes: E05B 81/08 using electromagnets or solenoids
• CPC Class Codes: E05B 81/78 as part of a hands-free locking or unlocking operation
• CPC Class Codes: E05F 15/73 responsive to movement or presence of persons or objects
• CPC Class Codes: E05F 15/76 responsive to devices carried by persons or objects, e.g. magnets or reflectors E05F15/77 takes precedence
• CPC Class Codes: E05F 15/77 using wireless control
• CPC Class Codes: E05F 2015/763 using acoustical sensors
• CPC Class Codes: E05F 2015/767 using cameras
• CPC Class Codes: E05Y 2900/50 for vehicles
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/175 Static expression
• CPC Class Codes: G08C 17/02 using a radio link

Abstract

Methods and systems for opening an access point of a vehicle. A system and a method may involve receiving wirelessly a signal from a remote controller carried by a user. The system and the method may further involve receiving audio or video data indicating the user approaching the vehicle. The system and the method may also involve determining an intention of the user to access an interior of the vehicle based on the audio or video data. The system and the method may also involve opening an access point of the vehicle responsive to the determining of the intention of the user to access the interior of the vehicle.

Claims

1. A method comprising:

receiving, by a system on a vehicle, audio or video data indicating a user approaching the vehicle;

determining, by the system, an intention of the user to access an interior of the vehicle based on the audio or video data indicating a predefined movement of a body part of the user; and

opening, by the system, an access point of the vehicle responsive to the determining,

wherein the receiving of the audio or video data indicating the user approaching the vehicle comprises receiving, from a camera, a video indicating the user approaching the vehicle, and

wherein the determining of the intention of the user comprises at least one of;

detecting an upward movement of shoulders or eyebrows of the user; and

analyzing the video to determine whether the user lacks a free hand or is unable to manually open a door at the access point.

2. The method of claim 1, wherein the video indicates the user approaching the vehicle with a cart, with a stroller, with a walker, or with a wheelchair.

3. The method of claim 1, wherein the determining of the intention of the user further comprises detecting a fixed gaze at the vehicle by the user for a predetermined period of time.

4. A method comprising:

receiving, by a system on a vehicle, audio or video data indicating a user approaching the vehicle;

determining, by the system, whether the user intends to access an interior of the vehicle based on the audio or video data; and

opening, by the system, an access point of the vehicle responsive to the determining,

wherein the determining of the intention of the user comprises;

receiving digital map data regarding a vicinity of the vehicle; and

determining one or more types of business in the vicinity of the vehicle based on the digital map data.

5. The method of claim 4, wherein the receiving of the audio or video data indicating the user approaching the vehicle comprises receiving, from a camera, a video indicating the user approaching the vehicle.

6. The method of claim 5, wherein the determining of the intention of the user comprises analyzing the video to determine whether the user lacks a free hand or is unable to manually open a door at the access point.

7. The method of claim 6, wherein the video indicates the user approaching the vehicle with a cart, with a stroller, with a walker, or with a wheelchair.

8. The method of claim 4, wherein the determining of the intention of the user further comprises detecting a fixed gaze at the vehicle by the user for a predetermined period of time.

9. The method of claim 4, wherein the determining of the intention of the user further comprises detecting an upward movement of shoulders or eyebrows of the user.

10. The method of claim 4, wherein the determining of the intention of the user further comprises:

observing a trajectory of a movement of the user indicating the user to be approaching the vehicle; and

determining, based on the trajectory, one of a plurality of access points of the vehicle as the access point through which the user intends to access the interior of the vehicle.

11. A method comprising:

receiving wirelessly, by a system on a vehicle, a signal from a remote controller carried by a user;

opening, by the system, an access point of the vehicle responsive to the signal indicating a command registered previously at the remote controller by the user within a predetermined time window before the receiving of the signal from the remote controller;

receiving, by the system, audio or video data indicating the user approaching the vehicle; and

determining, by the system, an intention of the user to access an interior of the vehicle based on the audio or video data.

12. The method of claim 11, wherein the receiving of the audio or video data indicating the user approaching the vehicle comprises receiving, from a camera, a video indicating the user approaching the vehicle.

13. The method of claim 12, wherein the determining of the intention of the user comprises analyzing the video to determine whether the user lacks a free hand or is unable to open a door at the access point manually.

14. The method of claim 13, wherein the video indicates the user approaching the vehicle with a cart, with a stroller, with a walker, or with a wheelchair.

15. The method of claim 11, wherein the determining of the intention of the user comprises detecting an upward movement of shoulders or eyebrows of the user.

16. The method of claim 11, wherein the determining of the intention of the user comprises:

receiving, by the system, digital map data regarding a vicinity of the vehicle; and

determining, by the system, one or more types of business in the vicinity of the vehicle based on the digital map data.