Facial recognition database created from social networking sites

• US 9,994,229 B2
• Filed: 04/25/2016
• Issued: 06/12/2018
• Est. Priority Date: 03/14/2012
• Status: Active Grant

• Current Assignee: AutoConnect Holdings LLC
• Original Assignee: AutoConnect Holdings LLC
• Inventors: Ricci, Christopher P.
• Primary Examiner(s): Holloway, Jason
• Application Number:
  US15/138,108
• Publication Number:
  US 20160325755A1
• Time in Patent Office: 778 Days
• Field of Search: 701 36, 382118
• CPC Class Codes: A61B 2503/04 Babies, e.g. for SIDS detection
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/4809 Sleep detection, i.e. determining whether a subject is asleep or not
• CPC Class Codes: A61B 5/6808 Diapers
• CPC Class Codes: A61B 5/7405 using sound
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 7/04 Electric stethoscopes microphones, acoustic transducers therefor H04R
• CPC Class Codes: B60C 1/00 Tyres characterised by the chemical composition or the physical arrangement or mixture of the composition
• CPC Class Codes: B60H 1/00742 by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
• CPC Class Codes: B60K 2360/11 Instrument graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/20 Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60N 2/0244 with logic circuits
• CPC Class Codes: B60Q 1/507 specific to autonomous vehicles
• CPC Class Codes: B60Q 1/52 for indicating emergencies
• CPC Class Codes: B60Q 1/544 for indicating other states or conditions of the vehicle occupants, e.g. for indicating disabled occupants
• CPC Class Codes: B60Q 9/00 : Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60R 11/04 : Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 25/00 : Fittings or systems for preventing or indicating unauthorised use or theft of vehicles locks for vehicles E05B77/00-E05B85/00
• CPC Class Codes: B60R 25/01 : operating on vehicle systems or fittings, e.g. on doors, seats or windscreens
• CPC Class Codes: B60R 25/1004 : Alarm systems characterised by the type of sensor, e.g. current sensing means using door lock sensors B60R25/1001
• CPC Class Codes: B60R 25/102 : a signal being sent to a remote location, e.g. a radio signal being transmitted to a police station, a security company or the owner
• CPC Class Codes: B60R 25/20 : Means to switch the anti-theft system on or off
• CPC Class Codes: B60R 25/2081 : combined with personal settings of other vehicle devices, e.g. mirrors, seats, steering wheels
• CPC Class Codes: B60R 25/25 : using biometry
• CPC Class Codes: B60R 25/257 : Voice recognition
• CPC Class Codes: B60W 2050/0067 : Confirmation by the driver
• CPC Class Codes: B60W 2050/0085 : Setting or resetting initial positions
• CPC Class Codes: B60W 50/085 : Changing the parameters of the control units, e.g. changing limit values, working points by control input
• CPC Class Codes: B60W 50/10 : Interpretation of driver requests or demands
• CPC Class Codes: B60W 50/14 : Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G01C 21/26 : specially adapted for navigation in a road network
• CPC Class Codes: G01C 21/3484 : Personalized, e.g. from learned user behaviour or user-defined profiles
• CPC Class Codes: G01C 21/362 : received from an external device or application, e.g. PDA, mobile phone or calendar application
• CPC Class Codes: G01C 21/365 : Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G01C 21/3667 : Display of a road map G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635
• CPC Class Codes: G01C 21/3691 : Retrieval, searching and output of information related to real-time traffic, weather, or environmental conditions arrangements for giving variable traffic instructions G08G1/09
• CPC Class Codes: G01C 21/3697 : Output of additional, non-guidance related information, e.g. low fuel level G01C21/3679 takes precedence
• CPC Class Codes: G01S 19/42 : Determining position
• CPC Class Codes: G02B 27/0093 : with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G05D 1/0016 : characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/021 : specially adapted to land vehicles
• CPC Class Codes: G05D 1/0276 : using signals provided by a source external to the vehicle involving a plurality of vehicles G05D1/0287; automatically controlling vehicle speed responsive to externally generated signals B60K31/0058
• CPC Class Codes: G05D 23/1917 : using digital means
• CPC Class Codes: G06F 16/183 : Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/24575 : using context
• CPC Class Codes: G06F 16/25 : Integrating or interfacing systems involving database management systems
• CPC Class Codes: G06F 16/252 : between a Database Management System and a front-end application
• CPC Class Codes: G06F 16/583 : using metadata automatically derived from the content
• CPC Class Codes: G06F 16/951 : Indexing; Web crawling techniques
• CPC Class Codes: G06F 21/00 : Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 21/31 : User authentication
• CPC Class Codes: G06F 21/32 : using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2203/04803 : Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 : based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/0622 : in relation to access
• CPC Class Codes: G06F 3/0637 : Permissions
• CPC Class Codes: G06F 3/0673 : Single storage device
• CPC Class Codes: G06F 9/451 : Execution arrangements for user interfaces
• CPC Class Codes: G06Q 10/00 : Administration; Management
• CPC Class Codes: G06Q 10/02 : Reservations, e.g. for tickets, services or events
• CPC Class Codes: G06Q 10/20 : Administration of product repair or maintenance
• CPC Class Codes: G06Q 20/308 : using the Internet of Things
• CPC Class Codes: G06Q 20/321 : using wearable devices
• CPC Class Codes: G06Q 20/384 : using social networks
• CPC Class Codes: G06Q 20/386 : using messaging services or messaging apps using mobile network messaging services for payment, e.g. SMS G06Q20/3255
• CPC Class Codes: G06Q 30/00 : Commerce
• CPC Class Codes: G06Q 30/012 : Providing warranty services
• CPC Class Codes: G06Q 30/0265 : Vehicular advertisement
• CPC Class Codes: G06Q 30/0266 : based on the position of the vehicle
• CPC Class Codes: G06Q 30/0633 : Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0639 : Item locations
• CPC Class Codes: G06Q 30/0641 : Shopping interfaces
• CPC Class Codes: G06Q 30/0645 : Rental transactions; Leasing transactions
• CPC Class Codes: G06Q 50/40 : Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 20/593 : Recognising seat occupancy
• CPC Class Codes: G06V 40/15 : Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/166 : using acquisition arrangements
• CPC Class Codes: G06V 40/168 : Feature extraction; Face representation
• CPC Class Codes: G06V 40/172 : Classification, e.g. identification
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/28 : Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G07C 5/02 : Registering or indicating driving, working, idle, or waiting time only apparatus forming part of taximeters G07B13/00
• CPC Class Codes: G07C 5/08 : Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
• CPC Class Codes: G07C 5/0825 : using optical means
• CPC Class Codes: G07C 5/0833 : using audio means
• CPC Class Codes: G07C 9/00563 : using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
• CPC Class Codes: G08B 13/19647 : Systems specially adapted for intrusion detection in or around a vehicle
• CPC Class Codes: G08B 21/0205 : Specific application combined with child monitoring using a transmitter-receiver system
• CPC Class Codes: G08B 21/06 : indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: G08B 21/18 : Status alarms G08B21/02 takes precedence
• CPC Class Codes: G08B 25/016 : Personal emergency signalling and security systems emergency non-personal manually actuated alarm activators G08B25/12
• CPC Class Codes: G08B 29/188 : Data fusion; cooperative systems, e.g. voting among different detectors
• CPC Class Codes: G08G 1/01 : Detecting movement of traffic to be counted or controlled G08G1/07 - G08G1/14 take precedence
• CPC Class Codes: G08G 1/07 : Controlling traffic signals
• CPC Class Codes: G08G 1/096725 : where the received information generates an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096741 : where the source of the transmitted information selects which information to transmit to each vehicle
• CPC Class Codes: G08G 1/096775 : where the origin of the information is a central station
• CPC Class Codes: G08G 1/0968 : Systems involving transmission of navigation instructions to the vehicle
• CPC Class Codes: G08G 1/096805 : where the transmitted instructions are used to compute a route
• CPC Class Codes: G08G 1/096811 : where the route is computed offboard
• CPC Class Codes: G08G 1/096844 : where the complete route is dynamically recomputed based on new data
• CPC Class Codes: G08G 1/164 : Centralised systems, e.g. external to vehicles
• CPC Class Codes: G08G 1/207 : with respect to certain areas, e.g. forbidden or allowed areas with possible alerting when inside or outside boundaries
• CPC Class Codes: G09G 2380/10 : Automotive applications
• CPC Class Codes: G09G 5/37 : Details of the operation on graphic patterns G09G5/38 takes precedence
• CPC Class Codes: H04L 51/02 : using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 63/0236 : Filtering by address, protocol, port number or service, e.g. IP-address or URL
• CPC Class Codes: H04L 63/0428 : wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/102 : Entity profiles
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/306 : User profiles
• CPC Class Codes: H04L 67/34 : involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/55 : Push-based network services
• CPC Class Codes: H04N 21/2225 : Local VOD servers
• CPC Class Codes: H04N 21/2265 : Server identification by a unique number or address, e.g. serial number network arrangements, protocols or services for addressing or naming H04L61/00
• CPC Class Codes: H04N 21/2393 : involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/25816 : involving client authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/41422 : located in transportation means, e.g. personal vehicle arrangements specially adapted for transportation systems in broadcast systems H04H20/62
• CPC Class Codes: H04N 21/43615 : Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/43637 : involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/454 : Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/6408 : Unicasting
• CPC Class Codes: H04N 21/64322 : IP
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04W 12/06 : Authentication
• CPC Class Codes: H04W 12/088 : using filters or firewalls
• CPC Class Codes: H04W 12/68 : Gesture-dependent or behaviour-dependent
• CPC Class Codes: H04W 36/0005 : Control or signalling for completing the hand-off
• CPC Class Codes: H04W 36/34 : Reselection control
• CPC Class Codes: H04W 4/021 : Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements
• CPC Class Codes: H04W 4/21 : for social networking applications
• CPC Class Codes: H04W 4/30 : Services specially adapted for particular environments, situations or purposes
• CPC Class Codes: H04W 4/40 : for vehicles, e.g. vehicle-to-pedestrians [V2P]
• CPC Class Codes: H04W 4/48 : for in-vehicle communication
• CPC Class Codes: H04W 4/60 : Subscription-based services using application servers or record carriers, e.g. SIM application toolkits
• CPC Class Codes: H04W 4/70 : Services for machine-to-machine communication [M2M] or machine type communication [MTC]
• CPC Class Codes: H04W 4/80 : Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 48/04 : based on user or terminal location or mobility data, e.g. moving direction, speed
• CPC Class Codes: H04W 76/11 : Allocation or use of connection identifiers
• CPC Class Codes: H04W 76/19 : Connection re-establishment
• CPC Class Codes: H04W 84/005 : Moving wireless networks
• CPC Class Codes: H04W 84/18 : Self-organising networks, e.g. ad-hoc networks or sensor networks
• CPC Class Codes: H05K 999/00 : dummy group
• CPC Class Codes: H05K 999/99 : dummy group
• CPC Class Codes: Y02A 90/10 : Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

Methods and systems for a complete vehicle ecosystem are provided. Specifically, systems that when taken alone, or together, provide an individual or group of individuals with an intuitive and comfortable vehicular environment. The present disclosure includes a system to create, modify, and maintain profiles associated with users. The user profiles are generated based on selectively collecting data associated with the users. Although each user profile may include settings, preferences, habits, and content associated with an individual user and/or vehicle, some user profiles may represent multiple users. These user profiles can change a configuration of a vehicle to match settings for a user, such as a driver and/or passenger. The configurations may also include the recognition of a unique set of gestures for a user. Further, the user profiles can be transferred from vehicle-to-vehicle and/or user-to-user.

Claims

1. A method, comprising:

detecting a user of a vehicle;

detecting a person other than the user via at least one image sensor associated with the vehicle;

identifying facial features associated with the person detected via the at least one sensor;

determining, in response to detecting the user of the vehicle, at least one contact having a social network connection with the user of the vehicle;

retrieving, based on the determined at least one contact, image information associated with the at least one contact from the social networking site, wherein the image information includes at least one identifying characteristic of the at least one contact;

storing the retrieved image information in a memory associated with the vehicle;

determining whether the identified facial features associated with the person match the at least one identifying characteristic of the at least one contact in the image information; and

when the identified facial features are determined to match the at least one identifying characteristic of the at least one contact, providing an output based on the determined match.

2. The method of claim 1, wherein detecting the user of the vehicle includes determining an identity of the user, and wherein the image data source is a social networking site.

3. The method of claim 1, wherein identifying the facial features associated with the person further comprises:

determining a measurement between at least one eye, eyebrow, nose, mouth, lip, chin, ear, and distinguishing facial mark, of the person.

4. The method of claim 1, wherein the identified facial features are determined not to match the at least one identifying characteristic of the at least one contact, the method further comprising:

determining to store information associated with the person in a recognition memory, wherein the information includes at least one of a geographical location of the person, a time of detecting the person, and the facial features of the person.

5. The method of claim 1, wherein when the identified facial features are determined to match the at least one identifying characteristic of the at least one contact, the

output is configured to present an identification of the person to the user.

6. The method of claim 5, wherein the output is provided to a display device of the vehicle, and wherein the identification of the person includes a name of the person and a relationship associated with the social network connection.

7. The method of claim 1, wherein the person detected is inside the vehicle and wherein the identified facial features are determined to match the at least one identifying characteristic of the at least one contact, the method further comprising:

determining at least one vehicle setting associated with the person detected inside the vehicle; and

storing the determined at least one vehicle setting associated with the person in the memory associated with the vehicle.

8. The method of claim 1, wherein the person detected is inside the vehicle and wherein the identified facial features are determined not to match the at least one identifying characteristic of the at least one contact, the method further comprising:

prompting the person for identification information;

receiving identification information provided by the person; and

storing the received identification information in the memory associated with the vehicle.

9. The method of claim 1, wherein the person detected is inside the vehicle and wherein the identified facial features are determined not to match the at least one identifying characteristic of the at least one contact, the method further comprising:

prompting the user for identification information about the person;

receiving identification information about the person provided by the user; and

storing the received identification information about the person in the memory associated with the vehicle.