LIGHT-BASED TOUCH CONTROLS ON A STEERING WHEEL AND DASHBOARD

• US 20140081521A1
• Filed: 11/25/2013
• Published: 03/20/2014
• Est. Priority Date: 02/15/2009
• Status: Active Grant

• Current Assignee: Neonode, Inc.
• Original Assignee: Neonode, Inc.
• Inventors: Frjdh, Gunnar Martin, Eriksson, Thomas, Karlsson, John, Berglind, Richard, Fellin, Simon, Hedin, Maria
• Granted Patent: US 8,775,023 B2
• Time in Patent Office: Days
• US Class Current: 701/36
• CPC Class Codes: B60K 2360/141 Activation of instrument input devices by approaching fingers or pens
• CPC Class Codes: B60K 2360/1446 Touch switches
• CPC Class Codes: B60K 2360/782 on the steering wheel
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60R 16/037 for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: B62D 1/046 Adaptations on rotatable parts of the steering wheel for accommodation of switches
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015

Abstract

A system for use in a vehicle, including a steering element situated opposite a driver seat in a vehicle, the steering element including a plurality of proximity sensors encased in the periphery of the steering element operable to detect hand gestures along the outer periphery of the steering element, an interactive deck housed in the vehicle, for providing at least one of radio broadcast, video broadcast, audio entertainment, video entertainment and navigational assistance in the vehicle, and a processor housed in the vehicle, coupled with the proximity sensors and the deck, operable to identify the hand gestures detected by the proximity sensors, and to control the deck in response to thus-identified hand gestures.

Claims

1. A system for use in a vehicle, comprising:

a steering element situated opposite a driver seat in a vehicle, the steering element comprising a plurality of proximity sensors encased in the periphery of the steering element operable to detect hand gestures along the outer periphery of the steering element;

an interactive deck housed in the vehicle, for providing at least one of radio broadcast, video broadcast, audio entertainment, video entertainment and navigational assistance in the vehicle; and

a processor housed in the vehicle, coupled with said proximity sensors and said deck, operable to identify the hand gestures detected by said proximity sensors, and to control said deck in response to thus-identified hand gestures.

2. The system of claim 1 wherein, in response to identifying an upward hand slide gesture, said processor increases an adjustable setting for said deck, and, in response to identifying a downward hand slide gesture, said processor decreases the adjustable setting.

3. The system of claim 2 wherein said deck operates in accordance with a plurality of features having adjustable settings, wherein said processor is operative to adjust a setting of a currently selected one of said features in response to identifying hand slide gestures, and wherein said processor is operative to change the currently selected feature in response to identifying at least one tap gesture on the outer periphery of said steering element.

4. The system of claim 3 wherein said deck comprises a display, and wherein, when said processor changes the selected feature, said processor also renders a graphic indicating the newly selected feature on said display.

5. The system of claim 2 wherein the adjustable settings are members of the group consisting of volume, radio channel, track in a music library, web page, map and picture.

6. The system of claim 1 further comprising a second plurality of proximity sensors encased in said steering element and facing the driver seat, for detecting hand wave gestures between said steering element and a driver, and wherein said processor is operable to identify the hand wave gestures detected by said second proximity sensors, and to change a mode of said deck in response to the thus-identified hand wave gestures.

7. The system of claim 6 wherein the vehicle comprises an airbag having an adjustable inflation setting, wherein said processor determines a distance between the driver and the steering element based on outputs from said second proximity sensors, and wherein said processor adjusts the inflation setting for the airbag based on the thus-determined distance.

8. The system of claim 1, wherein said processor identifies a series of objects detected by said proximity sensors as concurrently touching said steering element, as being respective fingers on one hand, wherein, when said proximity sensors detect that one of the objects is lifted from said steering element, said processor determines which of the fingers was lifted based on a relative location of the lifted object within the series of objects, and wherein said processor performs different functions in response to identifying gestures performed by different thus-determined ones of the fingers.

9. The system of claim 1 wherein said steering element further comprises:

a cavity;

an array of invisible-light emitters connected to said processor operable to project invisible light beams across said cavity; and

an array of light detectors connected to said processor operable to detect the invisible light beams projected by said invisible-light emitters, and to detect gestures inside said cavity that interrupt the invisible light beams projected by said invisible-light emitters, and wherein said processor is operable to identify the gestures inside said cavity detected by said light detectors, and to control said deck in response to the thus-identified gestures inside said cavity.

10. The system of claim 9, further comprising:

multiple arrays of invisible-light emitters connected to said processor and operable to project invisible light beams across different geometric planes inside said cavity; and

multiple arrays of light detectors connected to said processor and operable to detect the invisible light beams projected by said invisible-light emitters, and to detect wave gestures across multiple geometric planes inside said cavity that interrupt the invisible light beams projected by said invisible-light emitters,

and wherein said processor is operable to identify the wave gestures inside said cavity detected by said arrays of light detectors, and to control said deck in response to the thus-identified wave gestures.

11. The system of claim 9 further comprising visible-light emitters housed in said steering element and connected to said processor, and wherein said processor is operable to activate at least one of said visible-light emitters in response said light detectors detecting that the invisible light beams projected by said invisible-light emitters are being interrupted.

12. The system of claim 9, wherein said deck comprises a display, and wherein said processor is operable to enlarge an image on said display in response to identifying a multi-finger spread gesture inside said cavity.

13. The system of claim 12, wherein said processor is operable to pan the image on said display in response to identifying a one-finger translation gesture inside said cavity.

14. The system of claim 1 wherein said processor controls said deck in response to the identified hand gestures, only when said steering element is not substantially rotated.

15. The system of claim 1 further comprising a wireless phone interface for receiving incoming phone calls, and wherein said processor is operable to reject an incoming phone call in response to identifying a single tap gesture on the outer perimeter of said steering element, and to accept an incoming call in response to identifying a double tap gesture on the outer perimeter of said steering element.

16. The system of claim 1 wherein said processor is operable to mute said deck in response to identifying a sudden quick hand slide gesture along the outer periphery of said steering element.

17. The system of claim 1, wherein the periphery of said steering element is separated into virtual input zones, wherein said processor is operable to perform a different control command on said deck in response to identifying hand gestures in different input zones, and to render an image of said steering element on a display mounted in the vehicle, the image indicating which control command is associated with each input zone, in response to identifying at least one tap gesture on the outer periphery of said steering element.

18. The system of claim 1, wherein said processor is further operable to open a gas tank in the vehicle, open a trunk in the vehicle, lock doors of the vehicle, and close windows in the vehicle, in response to identifying respective hand gestures.

19. The system of claim 1, wherein said steering element comprises at least one interactive display embedded therein, wherein the vehicle comprises a vehicle display comprising either a head-down display or a head-up display, and wherein information displayed on said at least one interactive display is replicated on the vehicle display.

20. A dashboard for a vehicle, comprising:

a display;

a frame comprising proximity sensors for detecting hand gestures above the frame; and

a processor coupled with said display and said frame, operable to present a graphic representing a group of related functions in a corner of said display, and to identify the hand gestures detected by said proximity sensors, and wherein, in response to identifying a diagonal hand wave gesture above said frame and beginning above the corner of said display, the processor translates the graphic across said display thereby revealing icons for the related functions.

21. The dashboard of claim 20, wherein said processor is operable to present multiple graphics in respective corners of said display.