Vehicle vision system with gesture determination

• US 10,065,574 B2
• Filed: 07/10/2017
• Issued: 09/04/2018
• Est. Priority Date: 07/09/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Tiryaki, Riza
• Primary Examiner(s): Truong, Nguyen
• Application Number:
  US15/644,989
• Publication Number:
  US 20170305362A1
• Time in Patent Office: 421 Days
• Field of Search: 348148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/103 using camera systems provided with artificial illumination device, e.g. IR light source
• CPC Class Codes: B60R 2300/602 with an adjustable viewpoint
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A vehicular vision system includes an in-cabin camera having a field of view that encompasses at least a hand of a driver of the vehicle. A control includes an image processor operable to process image data captured by the in-cabin camera. The control, responsive to image processing by the image processor of image data captured by the in-cabin camera, is operable to determine a movement of a hand of the vehicle driver. Responsive to determination of the movement of the driver'"'"'s hand, the control is operable to determine if the movement is indicative of a gesture for controlling an accessory of the vehicle. Responsive to the determined gesture, the control may control pitch of another camera, yaw of another camera, roll of another camera, and/or a virtual viewing angle of a virtual camera of the bird'"'"'s eye view system.

Claims

1. A vehicular vision system, said vehicular vision system comprising:

an in-cabin camera disposed in an interior cabin of a vehicle equipped with said vehicular vision system, said in-cabin camera having a field of view that encompasses at least a hand of a driver of the equipped vehicle;

a control comprising an image processor operable to process image data captured by said in-cabin camera;

wherein said control, responsive to image processing by said image processor of image data captured by said in-cabin camera, is operable to determine a movement of a hand of a driver of the equipped vehicle;

wherein, responsive to determination of the movement of the driver'"'"'s hand, said control is operable to determine if the movement is indicative of a gesture for controlling an accessory of the equipped vehicle;

wherein said accessory comprises a camera of the equipped vehicle other than said in-cabin camera; and

wherein, responsive to the determined gesture, said control controls at least one of (i) pitch of said other camera, (ii) yaw of said other camera and (iii) roll of said other camera.

2. The vehicular vision system of claim 1, wherein the determined gesture comprises a gesture simulating resting the driver'"'"'s hand on a virtual ball.

3. The vehicular vision system of claim 1, wherein the determined gesture comprises a gesture simulating resting the driver'"'"'s hand on a virtual bowl.

4. The vehicular vision system of claim 1, wherein, responsive to the determined gesture, said control controls zooming of said other camera.

5. The vehicular vision system of claim 1, wherein, responsive to the determined gesture, said control controls movement of a viewpoint of said other camera.

6. The vehicular vision system of claim 5, wherein the determined gesture comprises the driver'"'"'s hand moving up, and wherein, responsive to determination of the driver'"'"'s hand moving up, said control moves a viewpoint of said other camera upwards.

7. The vehicular vision system of claim 5, wherein movement of the viewpoint of said other camera requires no actuator.

8. The vehicular vision system of claim 7, wherein said other camera has a field of view exterior of the equipped vehicle.

9. The vehicular vision system of claim 1, wherein said other camera has a field of view exterior of the equipped vehicle.

10. The vehicular vision system of claim 9, wherein said other camera has a field of view at least one of (i) forward of the equipped vehicle and (ii) sideward of the equipped vehicle.

11. The vehicular vision system of claim 9, wherein said other camera has a field of view at least one of (i) rearward of the equipped vehicle and (ii) sideward of the equipped vehicle.

12. The vehicular vision system of claim 9, wherein said other camera is part of a multi-camera surround vision system of the equipped vehicle.

13. A vehicular vision system, said vehicular vision system comprising:

an in-cabin camera disposed in an interior cabin of a vehicle equipped with said vehicular vision system, said in-cabin camera having a field of view that encompasses at least a hand of a driver of the equipped vehicle;

a control comprising an image processor operable to process image data captured by said in-cabin camera;

wherein said control, responsive to image processing by said image processor of image data captured by said in-cabin camera, is operable to determine a movement of a hand of a driver of the equipped vehicle;

wherein, responsive to determination of the movement of the driver'"'"'s hand, said control is operable to determine if the movement is indicative of a gesture for controlling a bird'"'"'s eye view system of the equipped vehicle; and

wherein, responsive to the determined gesture, said control controls a virtual viewing angle of a virtual camera of the bird'"'"'s eye view system.

14. The vehicular vision system of claim 13, wherein, responsive to the determined gesture, said control controls a view angle of the virtual camera.

15. The vehicular vision system of claim 13, wherein, responsive to the determined gesture, said control controls zooming of the virtual camera.

16. The vehicular vision system of claim 13, wherein, responsive to the determined gesture, said control controls movement of a viewpoint of the virtual camera.

17. The vehicular vision system of claim 13, wherein said control of the virtual viewing angle of the virtual camera occurs during a parking maneuver of the equipped vehicle.

18. A vehicular vision system, said vehicular vision system comprising:

an in-cabin camera disposed in an interior cabin of a vehicle equipped with said vehicular vision system, said in-cabin camera having a field of view that encompasses at least a hand of a driver of the equipped vehicle;

a control comprising an image processor operable to process image data captured by said in-cabin camera;

wherein said control, responsive to image processing by said image processor of image data captured by said in-cabin camera, is operable to determine a movement of a hand of a driver of the equipped vehicle;

wherein, responsive to determination of the movement of the driver'"'"'s hand, said control is operable to determine if the movement is indicative of a gesture for controlling an accessory of the equipped vehicle;

wherein said accessory comprises a camera of the equipped vehicle other than said in-cabin camera;

wherein said other camera has a field of view exterior of the equipped vehicle; and

wherein, responsive to the determined gesture, said control controls at least one of (i) movement of a viewpoint of said other camera and (ii) zooming of said other camera.

19. The vehicular vision system of claim 18, wherein, responsive to the determined gesture, said control controls movement of a viewpoint of said other camera, and wherein the determined gesture comprises the driver'"'"'s hand moving up, and wherein, responsive to determination of the driver'"'"'s hand moving up, said control moves a viewpoint of said other camera upwards.

20. The vehicular vision system of claim 18, wherein said other camera is part of a multi-camera surround vision system of the equipped vehicle.