Control and display system

• US 9,170,724 B2
• Filed: 04/01/2013
• Issued: 10/27/2015
• Est. Priority Date: 04/01/2013
• Status: Active Grant

• Current Assignee: Jet Optoelectronics Co., Ltd.
• Original Assignee: Jet Optoelectronics Co., Ltd.
• Inventors: Wen, Michael Tai-Hao
• Primary Examiner(s): Bali, Vikkram
• Application Number:
  US13/854,136
• Publication Number:
  US 20140298212A1
• Time in Patent Office: 939 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/182 Distributing information between displays
• CPC Class Codes: B60K 2360/184 Displaying the same information on different displays
• CPC Class Codes: B60K 2370/146 Input by gesture
• CPC Class Codes: B60K 2370/182 Distributing information between displays
• CPC Class Codes: B60K 2370/184 Displaying the same information on different displays
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials

Abstract

The invention is a control and display system. A system can be controlled either by a user'"'"'s gestures, a remote control or voice control. The image from a rear facing camera can be displayed either on a vehicle'"'"'s windshield by using a head up display. Alternatively, an image from a camera can be displayed on a head unit, which is located under the vehicle console between a driver seat and a front passenger seat.

Claims

1. A method of creating a look up table in the storage unit of a display system, wherein the display system comprises at least one sensor, a decoder, a processor, a storage unit, at least one display device;

wherein the sensor is connected to the decoder and the decoder is connected to the processor and the processor is connected to the storage unit;

wherein the sensor captures an input from a user and controls the operation of the display device based on the input from the user;

wherein the display device is located in vehicle seat back or in vehicle seat headrest; and

wherein one of the sensors is a motion detection sensor and the input from the user is a motion; and

the method comprising;

starting a gesture sensor program;

listing available applications;

displaying a menu for a selected application;

accepting a user command selection from the menu;

prompting the user to make a first gesture;

checking to find out if the user entered the first gesture or not;

prompting the user to enter a second gesture if the user entered the first gesture;

prompting the user to enter the first gesture if the user does not enter the first gesture;

comparing the second gesture and the first gesture if the user enters the second gesture;

associating the first gesture with the command if the first gesture and the second gesture are substantially similar; and

storing the first gesture and the corresponding command in a look up table in the storage unit.

2. The method of claim 1, wherein the first gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures;

and

wherein the second gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures.

3. A method of creating a look up table in the storage unit of a display system, wherein the display system comprises at least one sensor, a decoder, a processor, a storage unit, at least one display device;

wherein the sensor is connected to the decoder and the decoder is connected to the processor and the processor is connected to the storage unit;

wherein the sensor captures an input from a user and controls the operation of the display device based on the input from the user;

wherein the display device is located in vehicle seat back or in vehicle seat headrest;

wherein one of the sensors is a voice detection sensor and the input from the user is a word or a phrase or a combination of the word and the phrase;

the method comprising;

starting a voice sensor program;

listing available applications;

displaying a menu for a selected application;

accepting a user command selection from the menu;

prompting the user to speak a first voice command;

checking to find out if the user speaks the first voice command;

prompting the user to enter a second voice command if the user entered the first voice command;

prompting the user to speak the first voice command if the user does not enter the first voice command;

comparing the second voice command with the first voice command if the user speaks the second voice command;

associating the first voice command with the user command if the first voice command and the second voice command are substantially similar;

storing the first voice command and the corresponding user command in a look up table in the storage unit.

4. The method of claim 3 wherein the voice command is selected from a group consisting of a spoken word, a spoken phrase, and a combination of a spoken word and a spoken phrase.

5. A method of creating a look up table in the storage unit of a display system, wherein the display system comprises at least one sensor, a decoder, a processor, a storage unit, at least one display device;

wherein the sensor is connected to the decoder and the decoder is connected to the processor and the processor is connected to the storage unit;

wherein the sensor captures an input from a user and controls the operation of the display device based on the input from the user;

wherein the display device is located in vehicle seat back or in vehicle seat headrest; and

wherein one of the sensors is a motion detection sensor and the input from the user is a motion; and

the method comprising;

starting a gesture sensor program;

prompting the user to make a first gesture;

checking to find out if the user entered the first gesture or not;

prompting the user to enter a second gesture if the user entered the first gesture;

prompting the user to enter the first gesture if the user does not enter the first gesture;

prompting the user to perform an action;

comparing the second gesture and the first gesture if the user enters the second gesture;

associating the first gesture with the action if the first gesture and the second gesture are substantially similar; and

storing the first gesture and the corresponding action in a look up table in the storage unit.

6. The method of claim 5 wherein the first gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures;

and

wherein the second gesture is selected from a group consisting of hand gestures, feet gestures, head gestures, body gestures and a combination of hand, feet, head and body gestures.

7. A method of creating a look up table in the storage unit of a display system, wherein the display system comprises at least one sensor, a decoder, a processor, a storage unit, at least one display device;

wherein the sensor is connected to the decoder and the decoder is connected to the processor and the processor is connected to the storage unit;

wherein the sensor captures an input from a user and controls the operation of the display device based on the input from the user;

wherein the display device is located in vehicle seat back or in vehicle seat headrest; and

wherein one of the sensors is a voice detection sensor and the input from the user is a word or a phrase or a combination of the word and the phrase;

the method comprising;

starting a voice command program;

prompting the user to speak a first voice command;

checking to find out if the user spoken the first voice command or not;

prompting the user to speak a second voice command if the user spoken the first voice command;

prompting the user to speak the first voice command if the user does not speak the first voice command;

prompting the user to perform an action;

comparing the second voice command and the first voice command if the user enters the second voice command;

associating the first voice command with the action if the first voice command and the second voice command are substantially similar; and

storing the first voice command and the corresponding action in a look up table in the storage runt.

8. The method of claim 7 wherein the voice command is selected from a group consisting of a spoken word, a spoken phrase, and a combination of a spoken word and a spoken phrase.