VEHICLE OPERATING SYSTEM USING MOTION CAPTURE

• US 20160274669A1
• Filed: 12/14/2015
• Published: 09/22/2016
• Est. Priority Date: 03/16/2015
• Status: Active Grant

• Current Assignee: Thunder Power New Energy Vehicle Development Company Limited
• Original Assignee: Thunder Power Hong Kong Limited (Thunder Power Holdings Ltd.)
• Inventors: Hsiao, Jen-Chieh, Chen, Yong-Syuan
• Granted Patent: US 9,855,817 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B32B 15/00 Layered products comprising a layer of metal
• CPC Class Codes: B32B 15/01 all layers being exclusively metallic making layered metal workpieces by pressure cladding B23K20/22; making coatings with a metallic material characterised by its composition C23C30/00
• CPC Class Codes: B32B 2605/08 Cars
• CPC Class Codes: B32B 2605/18 Aircraft blades, propellers B32B2603/00
• CPC Class Codes: B32B 3/266 characterised by an apertured layer, the apertures going through the whole thickness of the layer, e.g. expanded metal, perforated layer, slit layer regular cells B32B3/12
• CPC Class Codes: B32B 7/04 Interconnection of layers
• CPC Class Codes: B32B 7/05 the layers not being connected over the whole surface, e.g. discontinuous connection or patterned connection using interposed adhesives or bonding materials applied in spaced arrangements B32B7/14
• CPC Class Codes: B60H 1/00278 for the battery arrangement of batteries B60R16/04
• CPC Class Codes: B60H 1/00392 for electric vehicles having only electric drive means
• CPC Class Codes: B60H 1/00564 of air ducts
• CPC Class Codes: B60H 1/00885 Controlling the flow of heating or cooling liquid, e.g. valves or pumps B60H1/00899 takes precedence; constructions of valves B60H1/00485
• CPC Class Codes: B60H 1/143 the heat being derived from cooling an electric component, e.g. electric motors, electric circuits, fuel cells or batteries
• CPC Class Codes: B60K 1/04 of the electric storage means for propulsion exchanging batteries for electric propulsion of vehicles B60L53/80; for auxiliary purposes only B60R16/04; supplying batteries to, or removing batteries from, vehicles B60S5/06
• CPC Class Codes: B60K 11/04 Arrangement or mounting of radiators, radiator shutters, or radiator blinds B60K11/085 takes precedence
• CPC Class Codes: B60K 11/085 with adjustable shutters or blinds
• CPC Class Codes: B60K 2001/005 the electric storage means
• CPC Class Codes: B60K 2001/006 the electric motors
• CPC Class Codes: B60L 50/64 Constructional details of batteries specially adapted for electric vehicles
• CPC Class Codes: B60L 58/24 for controlling the temperature of batteries
• CPC Class Codes: B60L 58/27 by heating
• CPC Class Codes: B60Y 2200/91 : Electric vehicles
• CPC Class Codes: B60Y 2306/07 : Heating of passenger cabins
• CPC Class Codes: B60Y 2400/112 : Batteries
• CPC Class Codes: C09J 5/00 : Adhesive processes in general; Adhesive processes not provided for elsewhere, e.g. relating to primers
• CPC Class Codes: F16B 11/00 : Connecting constructional elements or machine parts by sticking or pressing them together, e.g. cold pressure welding non-electric welding in general B23K; methods of using adhesives independently of the form of the surfaces joined C09J5/00
• CPC Class Codes: F16B 11/006 : by gluing gluing of plastics material B29C65/48
• CPC Class Codes: F16B 3/005 : the key being formed by solidification of injected material joining of preformed parts by applying molten plastics B29C65/40; non-disconnectible pipe joints obtained using a hardenable filler F16L13/11
• CPC Class Codes: F16B 5/04 : by means of riveting rivets F16B19/04
• CPC Class Codes: H01M 10/486 : for measuring temperature
• CPC Class Codes: H01M 10/625 : Vehicles
• CPC Class Codes: H01M 10/63 : Control systems charging or discharging in response to temperature H01M10/44 , H01M10/443; measurement of temperature H01M10/48 , H01M10/486
• CPC Class Codes: H01M 10/6568 : characterised by flow circuits, e.g. loops, located externally to the cells or cell casings
• CPC Class Codes: H01M 10/663 : the system being an air-conditioner or an engine
• CPC Class Codes: H01M 2220/20 : Batteries in motive systems, e.g. vehicle, ship, plane
• CPC Class Codes: H02J 7/0018 : using separate charge circuits
• CPC Class Codes: Y02E 60/10 : Energy storage using batteries
• CPC Class Codes: Y02T 10/70 : Energy storage systems for electromobility, e.g. batteries
• CPC Class Codes: Y02T 10/88 : Optimized components or subsystems, e.g. lighting, actively controlled glasses
• CPC Class Codes: Y10T 428/24347 : From both sides

Abstract

Vehicle operating systems for operating a vehicle having a driving seat for a vehicle driver and at least one passenger seat for passengers are described. The vehicle operating system may include one or more camera devices for shooting images of hand actions of the driver or images of hand actions of a passenger, and a storage device for storing operating signals corresponding to hand actions. A processing device may be configured to select the driver or the passengers as a gesture command operator, and to control the camera device to shoot hand action images of the selected gesture command operator. The command system may also be configured to convert the shot hand action images into corresponding operating signals according to hand action indicia stored in the storage device. The operating signals may be sent to execution devices, that execute the corresponding operations.

Claims

1. A vehicle operating system for operating a vehicle including a driving seat for a vehicle driver and at least one passenger seat for passengers, the vehicle operating system comprising:

camera devices for capturing at least one of images of gestures of the driver and images of gestures of a passenger;

a storage device for storing operating signals corresponding to gesture actions;

a processing device configured to;

control the camera devices to capture gesture action images of the driver and passenger simultaneously or substantially simultaneously,

convert the captured gesture action images into corresponding operating signals according to the operating signals corresponding to the gesture actions stored in the storage device,

determine a first operational signal is from a gesture by the driver and determine a second operational signal is from a gesture by the passenger, the first and second operational signals both for operating a same component of the vehicle,

determine whether the first operation signal is consistent with the second operation signal, and

send out the first operational signal and second operation signal as operating signals in a preset order in response to the determination that first operation signal is consistent with the second operation signal; and

execution devices configured to receive the operating signals sent by the processing device, and to execute operations corresponding to the operating signals.

2. The vehicle operating system of claim 1, wherein the same component being operated by first and second operational signals is not an in-vehicle camera.

3. The vehicle operating system of claim 2, wherein the same component being operated by first and second operational signals is not an in-vehicle camera includes an in vehicle air-conditioning system.

4. The vehicle operating system of claim 3, wherein the first operational signal is for navigating one or more options for the component.

5. The vehicle operating system of claim 1, wherein the first operational signal is for selecting an operational mode for the component.

6. The vehicle operating system of claim 1, wherein the camera devices are configured to capture an image from a body locating point of a corresponding gesture command operator to a hand of the gesture command operator, and wherein the processing device is configured to check whether the gesture image and the body locating point image are image-continuous, and if so, the gesture actions are converted into the operating signals.

7. The vehicle operating system of claim 6, wherein the body locating point comprises an arm, head or breast of the gesture command operator.

8. The vehicle operating system of claim 1, wherein each of the camera devices comprises a camera and a driving device for the camera, and the driving device configured for driving the camera to move or rotate.

9. The vehicle operating system of claim 8, wherein the driving device comprises a motor and a gear set.

10. The vehicle operating system of claim 1, wherein one of the camera devices is arranged in front of the driving seat.

11. The vehicle operating system of claim 1, wherein one of the camera devices is arranged at a different location providing a view of the back seat.

12. The vehicle operating system of claim 1, wherein the execution devices comprise at least one of a multimedia system, a door switch, a refill opening switch, Bluetooth equipment, a light switch and an air-conditioning system.

13. The vehicle operating system of claim 1, wherein,

the execution devices comprise a center console provided with at least one touch screen, the touch screen at least extends from the front part between the driving seat and the front passenger seat to the front part of the front passenger seat,

a touch screen operating interface is displayed on the touch screen, and

the center console can control the touch screen operating interface to move on the touch screen according to an operating signal.

14. The vehicle operating system of claim 1, wherein,

each operating signal corresponds to a two-step hand action,

a first step of the hand action is used for selecting an execution device, and

a second step of the hand action is used for instructing the selected execution device to carry out a specific operation.

15. An electric vehicle, comprising:

a driving seat for a vehicle driver;

at least one passenger seat for passengers; and

a vehicle operating system including;

camera devices for capturing gesture action images of the driver and passenger simultaneously or substantially simultaneously;

a storage device for storing operating signals corresponding to gesture actions;

a processing device configured to;

control the camera devices to capture gesture action images of the driver and passenger simultaneously or substantially simultaneously,

convert the captured gesture action images into corresponding operating signals based at least in part on a comparison between the gesture action images and parameters associated with the gesture actions,

determine a first operational signal is from a gesture by the driver and determine a second operational signal is from a gesture by the passenger, the first and second operational signals both for operating a same component of the vehicle,

determine whether the first operation signal is consistent with the second operation signal, and

send out the first operational signal and second operation signal as operating signals in a preset order in response to the determination that first operation signal is consistent with the second operation signal; and

an execution device configured to receive the operating signals sent by the processing device, and to execute operations corresponding to the operating signals.

16-20. -20. (canceled)

21. A method for operating a vehicle including a driving seat for a vehicle driver and at least one passenger seat for passengers, the method comprising:

storing operating signals corresponding to gesture actions;

controlling the camera devices to capture gesture action images of the driver and passenger simultaneously or substantially simultaneously;

converting the captured gesture action images into corresponding operating signals according to the operating signals corresponding to the gesture actions stored in the storage device;

determining a first operational signal is from a gesture action image for the driver and determine a second operational signal is from a gesture action image for the passenger, the first and second operational signals both for operating a same component of the vehicle;

determining whether the first operation signal is consistent with the second operation signal; and

send out the first operational signal and second operation signal as operating signals in a preset order in response to the determination that first operation signal is consistent with the second operation signal.

22. The method of claim 21, wherein the same component being operated by first and second operational signals is not an in-vehicle camera.

23. The method of claim 21, wherein the same component being operated by first and second operational signals is not an in-vehicle camera includes an in vehicle air-conditioning system.

24. The method of claim 21, wherein the first operational signal is for navigating one or more options for the component.

25. The method of claim 21, wherein the first operational signal is for selecting an operational mode for the component.