CONTROL AND DISPLAY SYSTEM

• US 20140298212A1
• Filed: 04/01/2013
• Published: 10/02/2014
• Est. Priority Date: 04/01/2013
• Status: Active Grant

• Current Assignee: Jet Optoelectronics Co., Ltd.
• Original Assignee: Jet City Electronics Inc. (Renesas Electronics Corporation)
• Inventors: Wen, Michael Tai-Hao
• Granted Patent: US 9,170,724 B2
• Time in Patent Office: Days
• US Class Current: 715/762
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/182 Distributing information between displays
• CPC Class Codes: B60K 2360/184 Displaying the same information on different displays
• CPC Class Codes: B60K 2370/146 Input by gesture
• CPC Class Codes: B60K 2370/182 Distributing information between displays
• CPC Class Codes: B60K 2370/184 Displaying the same information on different displays
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials

Abstract

The invention is a control and display system. A system can be controlled either by a user'"'"'s gestures, a remote control or voice control. The image from a rear facing camera can be displayed either on a vehicle'"'"'s windshield by using a head up display. Alternatively, an image from a camera can be displayed on a head unit, which is located under the vehicle console between a driver seat and a front passenger seat.

Claims

1. A display system comprising:

a sensor;

a decoder;

a processor;

a storage unit; and

a display device;

wherein the sensor is connected to the decoder and the decoder is connected to the processor and the processor is connected to the storage unit; and

wherein the sensor captures an input from a user and controls the operation of the display device based on the input from the user.

2. The sensor of claim 1 wherein the sensor is a motion detection sensor;

and the input from the user is a motion.

3. The sensor of claim 1 wherein the sensor is a voice detection sensor;

and the input from the user is a word or a phrase or a combination of the word and the phrase.

4. The sensor of claim 1 wherein the sensor is capable of detecting motion and voice.

5. The display system of claim 1 further comprising a camera.

6. The display system of claim 5 wherein the camera is connected to a head up display;

wherein the head up display displays images on a vehicle windshield.

7. The display system of claim 5 wherein the camera is connected to a head unit;

and the head unit displays images coming from the camera.

8. A method of creating a look up table in the storage device of the display device of claim 2 the method comprising:

starting a gesture sensor program;

listing available applications;

displaying a menu for a selected application;

accepting a user command selection from the menu;

prompting the user to make a first gesture;

checking to find out if the user entered the first gesture or not;

prompting the user to enter a second gesture if the user entered the first gesture;

prompting the user to enter the first gesture if the user does not enter the first gesture;

comparing the second gesture and the first gesture if the user enters the second gesture;

associating the first gesture with the command if the first gesture and the second gesture are substantially similar; and

storing the first gesture and the corresponding command in a look up table in the storage device.

9. The method of claim 8 wherein the first gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures;

and wherein the second gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures; and

wherein the second gesture.

10. A method of controlling the display device of claim 2 the method comprising:

capturing a gesture;

comparing the gesture with a plurality of gestures in the storage device;

locating a command that corresponds to the gesture in a look up table; and

executing the command.

11. The method of claim 10 wherein the gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures.

12. A method of creating a look up table in the storage device of the display device of claim 3 the method comprising:

starting a voice sensor program;

listing available applications;

displaying a menu for a selected application;

accepting a user command selection from the menu;

prompting the user to speak a first voice command;

checking to find out if the user speaks the first voice command;

prompting the user to enter a second voice command if the user entered the first voice command;

prompting the user to speak the first voice command if the user does not enter the first voice command;

comparing the second voice command with the first voice command if the user speaks the second voice command;

associating the first voice command with the user command if the first voice command and the second voice command are substantially similar;

storing the first voice command and the corresponding user command in a look up table in the storage device.

13. The method of claim 12 wherein the voice command is selected from a group consisting of a spoken word, a spoken phrase, and a combination of a spoken word and a spoken phrase.

14. A method of controlling the display device of claim 3 the method comprising:

capturing a voice command;

comparing the voice command with a plurality of voice commands in the storage device;

locating a user command that corresponds to the voice command in a look up table; and

executing the user command.

15. The method of claim 14 wherein the voice command is selected from a group consisting of a spoken word, a spoken phrase, and a combination of a spoken word and a spoken phrase.

16. A method of controlling the display device of claim 1 by using a smart device the method comprising:

displaying a list of discovered display devices;

prompting a user for selecting a smart device;

establishing a display data link between the smart device and the display device;

sending display information to the smart device;

accepting a command entered by the user to the smart device;

executing the command; and

continue accepting further commands from the smart device if the user selects to continue to control the display device from the smart device.

19. A method of creating a look up table in the storage device of the display device of claim 2 the method comprising:

starting a gesture sensor program;

prompting the user to make a first gesture;

checking to find out if the user entered the first gesture or not;

prompting the user to enter a second gesture if the user entered the first gesture;

prompting the user to enter the first gesture if the user does not enter the first gesture;

prompting the user to perform an action;

comparing the second gesture and the first gesture if the user enters the second gesture;

associating the first gesture with the action if the first gesture and the second gesture are substantially similar; and

storing the first gesture and the corresponding action in a look up table in the storage device.

20. The method of claim 19 wherein the first gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures;

and wherein the second gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures; and

wherein the second gesture.

21. A method of controlling the display device of claim 2 the method comprising:

capturing a gesture;

comparing the gesture with a plurality of gestures in the storage device;

locating an action that corresponds to the gesture in a look up table; and

performing the action.

22. The method of claim 21 wherein the gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures.

23. A method of creating a look up table in the storage device of the display device of claim 3 the method comprising:

starting a voice command program;

prompting the user to speak a first voice command;

checking to find out if the user spoken the first voice command or not;

prompting the user to speak a second voice command if the user spoken the first voice command;

prompting the user to speak the first voice command if the user does not speak the first voice command;

prompting the user to perform an action;

comparing the second voice command and the first voice command if the user enters the second voice command;

associating the first voice command with the action if the first voice command and the second voice command are substantially similar; and

storing the first gesture and the corresponding action in a look up table in the storage device.

24. The method of claim 23 wherein the voice command is selected from a group consisting of a spoken word, a spoken phrase, and a combination of a spoken word and a spoken phrase.

25. A method of controlling the display device of claim 3 the method comprising:

capturing a voice command;

comparing the voice command with a plurality of voice commands in the storage device;

locating an action that corresponds to the voice command in a look up table; and

executing the user command.

26. The method of claim 25 wherein the voice command is selected from a group consisting of a spoken word, a spoken phrase, and a combination of a spoken word and a spoken phrase.

27. The display system of claim 2 wherein the sensor can interpret gestures made by a user by using predefined gesture recognition.

28. The display system of claim 27 wherein the user can control the display system by making different gestures.

29. The display system of claim 1 wherein the user can control volume, brightness, power, wifi connection, screen power, and bluetooth connection.

17. A display system comprising:

a head up display; and

a camera;

wherein the camera is connected to the head up display and the head up display displays images on a vehicle windshield.

18. A display system comprising:

a head unit; and

a camera;

wherein the camera is connected to a head unit and the head unit displays images coming from the camera.