Universal vehicle voice command system

• US 20140309875A1
• Filed: 04/15/2014
• Published: 10/16/2014
• Est. Priority Date: 03/14/2012
• Status: Active Grant

• Current Assignee: AutoConnect Holdings LLC
• Original Assignee: Flextronics America LLC (Flextronics International Limited)
• Inventors: Ricci, Christopher P.
• Granted Patent: US 9,142,071 B2
• Time in Patent Office: Days
• US Class Current: 701/36
• CPC Class Codes: A61B 2503/04 Babies, e.g. for SIDS detection
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/4809 Sleep detection, i.e. determining whether a subject is asleep or not
• CPC Class Codes: A61B 5/6808 Diapers
• CPC Class Codes: A61B 5/7405 using sound
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 7/04 Electric stethoscopes microphones, acoustic transducers therefor H04R
• CPC Class Codes: B60C 1/00 Tyres characterised by the chemical composition or the physical arrangement or mixture of the composition
• CPC Class Codes: B60H 1/00742 by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
• CPC Class Codes: B60K 2360/11 Instrument graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2370/11 Graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2370/146 Input by gesture
• CPC Class Codes: B60K 2370/15 Output devices or features thereof
• CPC Class Codes: B60K 2370/193 for improving awareness
• CPC Class Codes: B60K 2370/52 Control of displays
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/20 Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/81 : for controlling displays
• CPC Class Codes: B60N 2/0244 : with logic circuits
• CPC Class Codes: B60Q 1/507 : specific to autonomous vehicles
• CPC Class Codes: B60Q 1/52 : for indicating emergencies
• CPC Class Codes: B60Q 1/544 : for indicating other states or conditions of the vehicle occupants, e.g. for indicating disabled occupants
• CPC Class Codes: B60Q 9/00 : Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60R 11/04 : Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 25/00 : Fittings or systems for preventing or indicating unauthorised use or theft of vehicles locks for vehicles E05B77/00-E05B85/00
• CPC Class Codes: B60R 25/01 : operating on vehicle systems or fittings, e.g. on doors, seats or windscreens
• CPC Class Codes: B60R 25/1004 : Alarm systems characterised by the type of sensor, e.g. current sensing means using door lock sensors B60R25/1001
• CPC Class Codes: B60R 25/102 : a signal being sent to a remote location, e.g. a radio signal being transmitted to a police station, a security company or the owner
• CPC Class Codes: B60R 25/20 : Means to switch the anti-theft system on or off
• CPC Class Codes: B60R 25/2081 : combined with personal settings of other vehicle devices, e.g. mirrors, seats, steering wheels
• CPC Class Codes: B60R 25/25 : using biometry
• CPC Class Codes: B60R 25/257 : Voice recognition
• CPC Class Codes: B60W 2050/0067 : Confirmation by the driver
• CPC Class Codes: B60W 2050/0085 : Setting or resetting initial positions
• CPC Class Codes: B60W 50/085 : Changing the parameters of the control units, e.g. changing limit values, working points by control input
• CPC Class Codes: B60W 50/10 : Interpretation of driver requests or demands
• CPC Class Codes: B60W 50/14 : Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G01C 21/26 : specially adapted for navigation in a road network
• CPC Class Codes: G01C 21/3484 : Personalized, e.g. from learned user behaviour or user-defined profiles
• CPC Class Codes: G01C 21/362 : received from an external device or application, e.g. PDA, mobile phone or calendar application
• CPC Class Codes: G01C 21/365 : Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G01C 21/3667 : Display of a road map G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635
• CPC Class Codes: G01C 21/3691 : Retrieval, searching and output of information related to real-time traffic, weather, or environmental conditions arrangements for giving variable traffic instructions G08G1/09
• CPC Class Codes: G01C 21/3697 : Output of additional, non-guidance related information, e.g. low fuel level G01C21/3679 takes precedence
• CPC Class Codes: G01S 19/42 : Determining position
• CPC Class Codes: G02B 27/0093 : with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G05D 1/0016 : characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/021 : specially adapted to land vehicles
• CPC Class Codes: G05D 1/0276 : using signals provided by a source external to the vehicle involving a plurality of vehicles G05D1/0287; automatically controlling vehicle speed responsive to externally generated signals B60K31/0058
• CPC Class Codes: G05D 23/1917 : using digital means
• CPC Class Codes: G06F 16/183 : Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/24575 : using context
• CPC Class Codes: G06F 16/25 : Integrating or interfacing systems involving database management systems
• CPC Class Codes: G06F 16/252 : between a Database Management System and a front-end application
• CPC Class Codes: G06F 16/583 : using metadata automatically derived from the content
• CPC Class Codes: G06F 16/951 : Indexing; Web crawling techniques
• CPC Class Codes: G06F 21/00 : Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 21/31 : User authentication
• CPC Class Codes: G06F 21/32 : using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2203/04803 : Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 : based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/0622 : in relation to access
• CPC Class Codes: G06F 3/0637 : Permissions
• CPC Class Codes: G06F 3/0673 : Single storage device
• CPC Class Codes: G06F 9/451 : Execution arrangements for user interfaces
• CPC Class Codes: G06Q 10/00 : Administration; Management
• CPC Class Codes: G06Q 10/02 : Reservations, e.g. for tickets, services or events
• CPC Class Codes: G06Q 10/20 : Administration of product repair or maintenance
• CPC Class Codes: G06Q 20/308 : using the Internet of Things
• CPC Class Codes: G06Q 20/321 : using wearable devices
• CPC Class Codes: G06Q 20/384 : using social networks
• CPC Class Codes: G06Q 20/386 : using messaging services or messaging apps using mobile network messaging services for payment, e.g. SMS G06Q20/3255
• CPC Class Codes: G06Q 30/00 : Commerce
• CPC Class Codes: G06Q 30/012 : Providing warranty services
• CPC Class Codes: G06Q 30/0265 : Vehicular advertisement
• CPC Class Codes: G06Q 30/0266 : based on the position of the vehicle
• CPC Class Codes: G06Q 30/0633 : Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0639 : Item locations
• CPC Class Codes: G06Q 30/0641 : Shopping interfaces
• CPC Class Codes: G06Q 30/0645 : Rental transactions; Leasing transactions
• CPC Class Codes: G06Q 50/40 : Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 20/593 : Recognising seat occupancy
• CPC Class Codes: G06V 40/15 : Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/166 : using acquisition arrangements
• CPC Class Codes: G06V 40/168 : Feature extraction; Face representation
• CPC Class Codes: G06V 40/172 : Classification, e.g. identification
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/28 : Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G07C 5/02 : Registering or indicating driving, working, idle, or waiting time only apparatus forming part of taximeters G07B13/00
• CPC Class Codes: G07C 5/08 : Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
• CPC Class Codes: G07C 5/0825 : using optical means
• CPC Class Codes: G07C 5/0833 : using audio means
• CPC Class Codes: G07C 9/00563 : using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
• CPC Class Codes: G08B 13/19647 : Systems specially adapted for intrusion detection in or around a vehicle
• CPC Class Codes: G08B 21/0205 : Specific application combined with child monitoring using a transmitter-receiver system
• CPC Class Codes: G08B 21/06 : indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: G08B 21/18 : Status alarms G08B21/02 takes precedence
• CPC Class Codes: G08B 25/016 : Personal emergency signalling and security systems emergency non-personal manually actuated alarm activators G08B25/12
• CPC Class Codes: G08B 29/188 : Data fusion; cooperative systems, e.g. voting among different detectors
• CPC Class Codes: G08G 1/01 : Detecting movement of traffic to be counted or controlled G08G1/07 - G08G1/14 take precedence
• CPC Class Codes: G08G 1/07 : Controlling traffic signals
• CPC Class Codes: G08G 1/096725 : where the received information generates an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096741 : where the source of the transmitted information selects which information to transmit to each vehicle
• CPC Class Codes: G08G 1/096775 : where the origin of the information is a central station
• CPC Class Codes: G08G 1/0968 : Systems involving transmission of navigation instructions to the vehicle
• CPC Class Codes: G08G 1/096805 : where the transmitted instructions are used to compute a route
• CPC Class Codes: G08G 1/096811 : where the route is computed offboard
• CPC Class Codes: G08G 1/096844 : where the complete route is dynamically recomputed based on new data
• CPC Class Codes: G08G 1/164 : Centralised systems, e.g. external to vehicles
• CPC Class Codes: G08G 1/207 : with respect to certain areas, e.g. forbidden or allowed areas with possible alerting when inside or outside boundaries
• CPC Class Codes: G09G 2380/10 : Automotive applications
• CPC Class Codes: G09G 5/37 : Details of the operation on graphic patterns G09G5/38 takes precedence
• CPC Class Codes: H04L 51/02 : using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 63/0236 : Filtering by address, protocol, port number or service, e.g. IP-address or URL
• CPC Class Codes: H04L 63/0428 : wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/102 : Entity profiles
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/306 : User profiles
• CPC Class Codes: H04L 67/34 : involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/55 : Push-based network services
• CPC Class Codes: H04N 21/2225 : Local VOD servers
• CPC Class Codes: H04N 21/2265 : Server identification by a unique number or address, e.g. serial number network arrangements, protocols or services for addressing or naming H04L61/00
• CPC Class Codes: H04N 21/2393 : involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/25816 : involving client authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/41422 : located in transportation means, e.g. personal vehicle arrangements specially adapted for transportation systems in broadcast systems H04H20/62
• CPC Class Codes: H04N 21/43615 : Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/43637 : involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/454 : Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/6408 : Unicasting
• CPC Class Codes: H04N 21/64322 : IP
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04W 12/06 : Authentication
• CPC Class Codes: H04W 12/088 : using filters or firewalls
• CPC Class Codes: H04W 12/68 : Gesture-dependent or behaviour-dependent
• CPC Class Codes: H04W 36/0005 : Control or signalling for completing the hand-off
• CPC Class Codes: H04W 36/34 : Reselection control
• CPC Class Codes: H04W 4/021 : Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements
• CPC Class Codes: H04W 4/21 : for social networking applications
• CPC Class Codes: H04W 4/30 : Services specially adapted for particular environments, situations or purposes
• CPC Class Codes: H04W 4/40 : for vehicles, e.g. vehicle-to-pedestrians [V2P]
• CPC Class Codes: H04W 4/48 : for in-vehicle communication
• CPC Class Codes: H04W 4/60 : Subscription-based services using application servers or record carriers, e.g. SIM application toolkits
• CPC Class Codes: H04W 4/70 : Services for machine-to-machine communication [M2M] or machine type communication [MTC]
• CPC Class Codes: H04W 4/80 : Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 48/04 : based on user or terminal location or mobility data, e.g. moving direction, speed
• CPC Class Codes: H04W 76/11 : Allocation or use of connection identifiers
• CPC Class Codes: H04W 76/19 : Connection re-establishment
• CPC Class Codes: H04W 84/005 : Moving wireless networks
• CPC Class Codes: H04W 84/18 : Self-organising networks, e.g. ad-hoc networks or sensor networks
• CPC Class Codes: H05K 999/00 : dummy group
• CPC Class Codes: H05K 999/99 : dummy group
• CPC Class Codes: Y02A 90/10 : Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

Methods and systems are presented for accepting inputs into a vehicle or other conveyance to control functions of the conveyance. A vehicle control system can receive gestures and other inputs. The vehicle control system can also obtain information about the user of the vehicle control system and information about the environment in which the conveyance is operating. Based on the input and the other information, the vehicle control system can modify or improve the performance or execution of user interface and functions of the conveyance. The changes make the user interfaces and/or functions user-friendly and intuitive.

Claims

1. A method for controlling a user interface in a conveyance, comprising:

a vehicle control system, including a processor, providing content on the user interface;

the vehicle control system determining if a user within the conveyance should be prohibited from viewing the content;

the vehicle control system determining a location of the prohibited user; and

the vehicle control system modifying a display of the content to prevent viewing by the prohibited user.

2. The method of claim 1, wherein the content is a movie.

3. The method of claim 1, wherein the prohibited user is a driver.

4. The method of claim 1, wherein the prohibited user is another passenger.

5. The method of claim 4, wherein the other passenger is identified as a child.

6. The method of claim 1, wherein at least a portion of the user interface is blacked out.

7. The method of claim 6, wherein the at least a portion of the user interface is blacked out when the prohibited user looks at the user interface.

8. The method of claim 7, wherein the user interface is pivoted away from the prohibited user.

9. The method of claim 8, further comprising:

the vehicle control system determining if the prohibited user should receive audio associated with the content; and

if the prohibited user should not receive audio associated with the content, changing an audio signal to prevent listening by the prohibited user.

10. The method of claim 9, wherein a noise cancelling signal is sent to a zone associated with the prohibited user.

11. A conveyance comprising:

a processor operable to execute one or more modules, the modules comprising;

a media controller operable to;

provide content on the user interface;

modify a display of the content to prevent viewing by a user;

a user customization module operable to;

determine if the user within the conveyance should be prohibited from viewing the content; and

determine a location of the prohibited user.

12. The conveyance of claim 11, wherein the content is a movie.

13. The conveyance of claim 12, wherein the prohibited user is one of a driver, another passenger, or a child passenger.

14. The conveyance of claim 13, wherein the display is modified by one of at least a portion of the user interface is blacked out when the prohibited user looks at the user interface or the display is pivoted away from the prohibited user.

15. The conveyance of claim 14, wherein the user customization module is further operable to:

determine if the prohibited user should receive audio associated with the content; and

if the prohibited user should not receive audio associated with the content, change an audio signal to prevent listening by the prohibited user, wherein a noise cancelling signal is sent to a zone associated with the prohibited user.

16. A non-transitory computer readable medium stored on a storage medium and having instructions that when executed by a processor cause the processor to perform a method, the instructions comprising:

instructions to provide content on the user interface;

instructions to determine if a user within the conveyance should be prohibited from viewing the content; and

instructions to determine a location of the prohibited user;

instructions to modify a display of the content to prevent viewing by the prohibited user.

17. The computer readable medium of claim 16, wherein the content is a movie.

18. The computer readable medium of claim 17, wherein the prohibited user is one of a driver, another passenger, or a child passenger.

19. The computer readable medium of claim 18, wherein the display is modified by one of at least a portion of the user interface is blacked out when the prohibited user looks at the user interface or the display is pivoted away from the prohibited user.

20. The computer readable medium of claim 19, further comprising:

instructions to determine if the prohibited user should receive audio associated with the content; and

if the prohibited user should not receive audio associated with the content, instructions to change an audio signal to prevent listening by the prohibited user, wherein a noise cancelling signal is sent to a zone associated with the prohibited user.