Methods and systems for opening of a vehicle access point using audio or video data associated with a user

• US 10,508,485 B2
• Filed: 09/21/2018
• Issued: 12/17/2019
• Est. Priority Date: 02/17/2016
• Status: Active Grant

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Myers, Scott Vincent, Nallapa, Venkatapathi Raju, Gurghian, Alexandru Mihai
• Primary Examiner(s): Rushing, Mark S
• Application Number:
  US16/138,437
• Publication Number:
  US 20190032390A1
• Time in Patent Office: 452 Days
• Field of Search: 34042615
• CPC Class Codes: E05B 81/08 using electromagnets or solenoids
• CPC Class Codes: E05B 81/78 as part of a hands-free locking or unlocking operation
• CPC Class Codes: E05F 15/73 responsive to movement or presence of persons or objects
• CPC Class Codes: E05F 15/76 responsive to devices carried by persons or objects, e.g. magnets or reflectors E05F15/77 takes precedence
• CPC Class Codes: E05F 15/77 using wireless control
• CPC Class Codes: E05F 2015/763 using acoustical sensors
• CPC Class Codes: E05F 2015/767 using cameras
• CPC Class Codes: E05Y 2900/50 for vehicles
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/175 Static expression
• CPC Class Codes: G08C 17/02 using a radio link

Abstract

Methods and systems for opening an access point of a vehicle. A system and a method may involve receiving wirelessly a signal from a remote controller carried by a user. The system and the method may further involve receiving audio or video data indicating the user approaching the vehicle. The system and the method may also involve determining an intention of the user to access an interior of the vehicle based on the audio or video data. The system and the method may also involve opening an access point of the vehicle responsive to the determining of the intention of the user to access the interior of the vehicle.

Claims

1. A method comprising:

receiving, by a system on a vehicle, audio or video data indicating a user approaching the vehicle;

determining, by the system, an intention of the user with respect to accessing an interior of the vehicle based on the audio or video data and one or more types of business in a vicinity of the vehicle; and

opening, by the system, an access point of the vehicle responsive to the determining.

2. The method of claim 1, wherein the receiving of the audio or video data indicating the user approaching the vehicle comprises receiving, from a camera, a video indicating the user approaching the vehicle.

3. The method of claim 1, wherein the determining of the intention of the user comprises analyzing the video data to determine whether the user lacks a free hand or is unable to manually open a door at the access point.

4. The method of claim 3, wherein the video data indicates the user approaching the vehicle with a cart, with a stroller, with a walker, or with a wheelchair.

5. The method of claim 1, wherein the determining of the intention of the user comprises analyzing the video data to detect a fixed gaze at the vehicle by the user for a predetermined period of time.

6. The method of claim 1, wherein the determining of the intention of the user comprises analyzing the video data to detect an upward movement of shoulders or eyebrows of the user.

7. The method of claim 1, wherein the determining of the intention of the user further comprises:

observing a trajectory of a movement of the user indicating the user to be approaching the vehicle; and

determining, based on the trajectory, one of a plurality of access points of the vehicle as the access point through which the user intends to access the interior of the vehicle.

8. The method of claim 1, further comprising:

receiving, by the system, digital map data regarding the vicinity of the vehicle; and

determining, by the system, the one or more types of business in the vicinity of the vehicle based on the digital map data.

9. A system implementable in a vehicle, comprising:

an actuator capable of opening and closing an access point of the vehicle;

one or more sensors capable of sensing audio or video data indicating a user approaching the vehicle; and

a processor coupled to the actuator and the one or more sensors, the processor capable of;

receiving the audio or video data from the one or more sensors;

determining an intention of the user with respect to accessing an interior of the vehicle based on the audio or video data and one or more types of business in a vicinity of the vehicle; and

controlling the actuator to open the access point responsive to the determining.

10. The system of claim 9, wherein in determining the intention of the user the processor is capable of analyzing the video data to determine whether the user lacks a free hand or is unable to manually open a door at the access point.

11. The apparatus of claim 10, wherein the video data indicates the user approaching the vehicle with a cart, with a stroller, with a walker, or with a wheelchair.

12. The system of claim 9, wherein in determining the intention of the user the processor is capable of analyzing the video data to detect a fixed gaze at the vehicle by the user for a predetermined period of time.

13. The system of claim 9, wherein in determining the intention of the user the processor is capable of analyzing the video data to detect an upward movement of shoulders or eyebrows of the user.

14. The system of claim 9, wherein in determining the intention of the user the processor is capable of:

observing a trajectory of a movement of the user indicating the user to be approaching the vehicle; and

determining, based on the trajectory, one of a plurality of access points of the vehicle as the access point through which the user intends to access the interior of the vehicle.

15. The system of claim 9, wherein the processor is further capable of:

receiving digital map data regarding the vicinity of the vehicle; and

determining the one or more types of business in the vicinity of the vehicle based on the digital map data.