Vision system for vehicle

• US 9,632,590 B2
• Filed: 04/18/2016
• Issued: 04/25/2017
• Est. Priority Date: 09/27/2006
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Kramer, Mark E., Lynam, Niall R., O'Connell, David P., Nise, Vernon R.
• Primary Examiner(s): Nguyen, Kevin
• Application Number:
  US15/131,594
• Publication Number:
  US 20160231827A1
• Time in Patent Office: 372 Days
• Field of Search: 715781, 715744, 715780, 715810, 715855, 715851-853
• CPC Class Codes: B60K 2360/126 Rotatable input devices for instruments
• CPC Class Codes: B60K 2360/135 Joysticks
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/1526 Dual-view displays
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 11/02 for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
• CPC Class Codes: B60R 11/0235 of flat type, e.g. LCD
• CPC Class Codes: B60R 11/0241 for telephones
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2001/1284 : with communication systems other than radio-receivers, e.g. keyless entry systems, navigation systems; with anti-collision systems
• CPC Class Codes: B60R 2011/0026 : Windows, e.g. windscreen
• CPC Class Codes: B60R 2011/0033 : Rear-view mirrors
• CPC Class Codes: B60R 2011/0063 : using adhesive means, e.g. hook and loop fasteners
• CPC Class Codes: B60R 2011/0075 : using a containment or docking space
• CPC Class Codes: B60R 2011/0085 : with adjustment by rotation in their operational position
• CPC Class Codes: B60R 2300/105 : using multiple cameras
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/303 : using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/802 : for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/8093 : for obstacle warning
• CPC Class Codes: G01C 21/265 : constructional aspects of navigation devices, e.g. housings, mountings, displays G01C21/3688 takes precedence
• CPC Class Codes: G01C 21/3611 : using character input or menus, e.g. menus of POIs character input methods in general G06F3/0233
• CPC Class Codes: G01C 21/3614 : through interaction with a road map, e.g. selecting a POI icon on a road map
• CPC Class Codes: G01C 21/362 : received from an external device or application, e.g. PDA, mobile phone or calendar application
• CPC Class Codes: G01C 21/3629 : Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G01C 21/3632 : Guidance using simplified or iconic instructions, e.g. using arrows G01C21/365 takes precedence
• CPC Class Codes: G01C 21/3644 : Landmark guidance, e.g. using POIs or conspicuous other objects
• CPC Class Codes: G01C 21/3664 : Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/367 : Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker
• CPC Class Codes: G01C 21/3682 : output of POI information on a road map G01C21/3614, G01C21/3685 take precedence
• CPC Class Codes: G01C 21/3688 : Systems comprising multiple parts or multiple output devices (not client-server), e.g. detachable faceplates, key fobs or multiple output screens
• CPC Class Codes: G06F 3/01 : Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/16 : Sound input; Sound output speech processing G10L
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 20/597 : Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/28 : Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04M 1/6091 : including a wireless interface
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A vision system for a vehicle includes a camera having a field of view that encompasses a front seat of the vehicle so as to capture images of an occupant of the vehicle. An image processor is provided with image data captured by the camera and the image processor image processes image data captured by the camera. The image processor, responsive at least in part to image processing of image data captured by the camera, recognizes movement representative of a hand gesture made by the occupant of the vehicle. The image processor is a system-on-a-chip image processor. The control may control a device of the vehicle responsive at least in part to the recognition of the hand gesture.

Claims

1. A vision system for a vehicle, said vision system comprising:

a camera disposed in a vehicle equipped with said vision system, said camera having a field of view that encompasses a front seat of the equipped vehicle so as to capture images of an occupant of the equipped vehicle;

said camera capturing image data;

an image processor;

said image processor provided with image data captured by said camera;

said image processor image processing image data captured by said camera;

said image processor, responsive at least in part to image processing of image data captured by said camera, recognizing movement;

wherein said movement comprises a hand gesture made by the occupant of the equipped vehicle; and

wherein said image processor comprises a system-on-a-chip image processor.

2. The vision system of claim 1, wherein a navigation device support structure for supporting a portable navigation device is disposed in the equipped vehicle, and wherein said navigation device support structure comprises an articulatable receiving structure that is articulatable to adjust an orientation of the portable navigation device supported thereon.

3. The vision system of claim 2, wherein said navigation device support structure is articulatable between a stowed position and a use position.

4. The vision system of claim 1, comprising a portable hand-held device capable of being carried into and out of the equipped vehicle, wherein said portable hand-held device is operable to wirelessly communicate with a vehicle-based receiver.

5. The vision system of claim 4, comprising a display device viewable by a driver of the equipped vehicle, and wherein said display device is operable to display a listing of choices in response to a wireless communication between said portable hand-held device and said vehicle-based receiver.

6. The vision system of claim 5, wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of messages, (b) a listing of phone numbers, (c) a listing of emails and (d) a listing of titles or tracks.

7. The vision system of claim 6, wherein said portable hand-held device comprises a portable phone.

8. The vision system of claim 7, wherein said listing of choices displayed by said display device comprises a listing of emails and wherein said listing of emails comprises at least one of a received email and a transmitted email.

9. The vision system of claim 5, wherein said wireless communication comprises a Bluetooth wireless communication.

10. The vision system of claim 5, wherein said listing of choices displayed by said display device is derived, at least in part, from data stored by said portable hand-held device.

11. The vision system of claim 5, wherein said display assembly comprises a video display device.

12. The vision system of claim 11, wherein said video display device is operable to display images representative of a scene occurring exterior of the vehicle.

13. The vision system of claim 12, wherein said video display device comprises a non-electronic graphic overlay means that is viewable when said video display device is activated.

14. The vision system of claim 1, wherein said system-on-a-chip image processor comprises an EyeQ™

system-on-a-chip image processor.

15. The vision system of claim 1, wherein said image processor is operable to recognize American Sign Language gestures.

16. A vision system for a vehicle, said vision system comprising:

a camera disposed in a vehicle equipped with said vision system, said camera having a field of view that encompasses a front seat of the equipped vehicle so as to capture images of a driver of the equipped vehicle;

said camera capturing image data;

a control comprising an image processor;

said image processor provided with image data captured by said camera;

said image processor image processing image data captured by said camera;

said image processor, responsive at least in part to image processing of image data captured by said camera, recognizing movement;

wherein said movement comprises a hand gesture made by the driver of the equipped vehicle;

wherein said image processor comprises a system-on-a-chip image processor; and

wherein, responsive at least in part to said recognition of said hand gesture, said control controls a device of the equipped vehicle.

17. The vision system of claim 16, wherein said system-on-a-chip image processor comprises an EyeQ™

system-on-a-chip image processor.

18. The vision system of claim 17, wherein said device comprises an interior rearview mirror of the equipped vehicle.

19. A vision system for a vehicle, said vision system comprising:

a camera disposed in a vehicle equipped with said vision system, said camera having a field of view that encompasses a front seat of the equipped vehicle so as to capture images of a driver of the equipped vehicle;

said camera capturing image data;

a control comprising an image processor;

said image processor provided with image data captured by said camera;

said image processor image processing image data captured by said camera;

said image processor, responsive at least in part to image processing of image data captured by said camera, recognizing movement;

wherein said movement comprises a hand gesture made by the driver of the equipped vehicle;

wherein said image processor comprises a system-on-a-chip image processor;

wherein, responsive at least in part to said recognition of said hand gesture, said control controls a device of the equipped vehicle;

a display device viewable by the driver of the equipped vehicle;

wherein said display assembly comprises a video display device; and

wherein said video display device is operable to display images representative of a scene occurring exterior of the vehicle.

20. The vision system of claim 19, wherein said system-on-a-chip image processor comprises an EyeQ™

system-on-a-chip image processor.