Methods and systems for opening of a vehicle access point using audio or video data associated with a user

• US 9,816,308 B2
• Filed: 02/17/2016
• Issued: 11/14/2017
• Est. Priority Date: 02/17/2016
• Status: Active Grant

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Myers, Scott Vincent, Nallapa, Venkatapathi Raju, Gurghian, Alexandru Mihai
• Primary Examiner(s): RUSHING, MARK S
• Application Number:
  US15/045,890
• Publication Number:
  US 20170234053A1
• Time in Patent Office: 636 Days
• Field of Search: 34042615
• CPC Class Codes: E05B 81/08 using electromagnets or solenoids
• CPC Class Codes: E05B 81/78 as part of a hands-free locking or unlocking operation
• CPC Class Codes: E05F 15/73 responsive to movement or presence of persons or objects
• CPC Class Codes: E05F 15/76 responsive to devices carried by persons or objects, e.g. magnets or reflectors E05F15/77 takes precedence
• CPC Class Codes: E05F 15/77 using wireless control
• CPC Class Codes: E05F 2015/763 using acoustical sensors
• CPC Class Codes: E05F 2015/767 using cameras
• CPC Class Codes: E05Y 2900/50 for vehicles
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/175 Static expression
• CPC Class Codes: G08C 17/02 using a radio link

Abstract

Methods and systems for opening an access point of a vehicle. A system and a method may involve receiving wirelessly a signal from a remote controller carried by a user. The system and the method may further involve receiving audio or video data indicating the user approaching the vehicle. The system and the method may also involve determining an intention of the user to access an interior of the vehicle based on the audio or video data. The system and the method may also involve opening an access point of the vehicle responsive to the determining of the intention of the user to access the interior of the vehicle.

Claims

1. A method comprising:

receiving wirelessly, by a system on a vehicle, a signal from a remote controller carried by a user;

receiving, by the system, audio or video data indicating the user approaching the vehicle;

determining, by the system, whether the user intends to access an interior of the vehicle based on the audio or video data; and

opening, by the system, an access point of the vehicle responsive to the determining,

wherein the receiving of the audio or video data indicating the user approaching the vehicle comprises receiving from a camera, a video indicating the user approaching the vehicle, and

wherein the determining of the invention of the user comprises analyzing the video to determine whether the user lacks a free hand or is unable to open a door at the access point manually.

2. The method of claim 1, wherein the audio or video data comprises a voice command from the user.

3. The method of claim 1, wherein the video indicates the user approaching the vehicle with a shopping cart, with a baby stroller, with a walker, or in a wheelchair.

4. The method of claim 1, wherein the determining of the intention of the user comprises detecting a fixed gaze at the vehicle by the user for a predetermined period of time.

5. The method of claim 1, wherein the determining of the intention of the user comprises detecting an upward movement of shoulders or eyebrows of the user.

6. The method of claim 1, wherein the determining of the intention of the user comprises:

observing a trajectory of a movement of the user indicating the user to be approaching the vehicle; and

determining, based on the trajectory, one of a plurality of access points of the vehicle as the access point through which the user intends to access the interior of the vehicle.

7. The method of claim 1, wherein the determining of the intention of the user comprises:

receiving, by the system, digital map data regarding a vicinity of the vehicle; and

determining, by the system, one or more types of business in the vicinity of the vehicle based on the digital map data.

8. A system for opening an access point of a vehicle, comprising:

a wireless communication module configured to receive a signal wirelessly from a remote controller;

one or more processors; and

memory configured to store a plurality of components executable by the one or more processors, the plurality of components comprising;

a data receiver configured to receive audio or video data indicating a user approaching the vehicle;

a data analyzer configured to analyze the audio or video data and determine whether the user lacks a free hand or is unable to open a door at the access point manually;

an intention detector configured to determine whether the user intends to access an interior of the vehicle; and

a notification module configured to provide a notification to open the access point automatically.

9. The system of claim 8, further comprising:

one or more sensors configured to generate the audio or video data indicating the user approaching the vehicle; and

one or more actuators configured to unlock and open the door at the access point automatically.

10. The system of claim 9, wherein the one or more sensors comprise a video camera disposed on the vehicle.

11. The system of claim 9, wherein the one or more actuators comprise a latch solenoid and a pre-sprung or motorized opening mechanism for the door at the access point.

12. The system of claim 8, wherein, in determining whether the user lacks a free hand or is unable to open the door at the access point manually, the data analyzer is configured to detect a location of the remote controller with respect to the user.

13. The system of claim 8, wherein, in determining whether the user lacks a free hand or is unable to open the door at the access point manually, the data analyzer is configured to detect whether both hands of the user are occupied with one or more objects other than the remote controller.

14. The system of claim 8, wherein, in determining whether the user intends to access the interior of the vehicle, the intention detector is configured to observe a trajectory of a movement of the user indicating the user to be approaching the vehicle and determine, based on the trajectory, one of a plurality of access points of the vehicle as the access point through which the user intends to access the interior of the vehicle.

15. The system of claim 8, wherein, in determining whether the user intends to access the interior of the vehicle, the intention detector is configured to detect a fixed gaze at the vehicle by the user for a predetermined period of time.

16. The system of claim 8, wherein, in determining whether the user intends to access the interior of the vehicle, the intention detector is configured to detect an upward movement of shoulders or eyebrows of the user.

17. The system of claim 8, wherein, in determining the intention of the user, the intention detector is configured to receive digital map data regarding a vicinity of the vehicle and determine one or more types of business in the vicinity of the vehicle based on the digital map data.