Contextually intelligent communication systems and processes

• US 9,338,622 B2
• Filed: 09/28/2013
• Issued: 05/10/2016
• Est. Priority Date: 10/04/2012
• Status: Active Grant

• Current Assignee: Bernt Erik Bjontegard
• Original Assignee: Bernt Erik Bjontegard
• Inventors: Bjontegard, Bernt Erik
• Primary Examiner(s): Shen, Qun
• Application Number:
  US14/040,677
• Publication Number:
  US 20140171039A1
• Time in Patent Office: 955 Days
• Field of Search: 455/414.1, 455/456.1
• US Class Current: 1/1
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/217 using environment-related information, i.e. information generated otherwise than by the player, e.g. ambient temperature or humidity
• CPC Class Codes: A63F 13/32 using local area network [LAN] connections
• CPC Class Codes: A63F 13/332 using wireless networks, e.g. cellular phone networks
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 13/79 involving player-related data, e.g. identities, accounts, preferences or play histories
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/185 by embedding added-value information into content, e.g. geo-tagging
• CPC Class Codes: H04W 84/042 Public Land Mobile systems, e.g. cellular systems
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

A contextually intelligent communication system and processes acquire and processes data on the current context of a user who is using a connected mobile communication device such as a smart phone or tablet by using various sensors, image recognition or augmented reality residing in the connected device; providing additional data to define the user'"'"'s current environment; combining the contextual data on the device with the additional data to define the user'"'"'s complete, relevant context; gathering the user'"'"'s current context data and updating the device by uploading the data via a wide area mobile network to a contextually intelligent server in the cloud, matching the user'"'"'s current contextual data with the user'"'"'s past and historical data and then downloading updated data back to the device, with the updated data including any of a variety of contextually relevant information such as feedback, experiences, recommendations, offers, coupons, advice, tactile feedback, content such as visual and audio representations, augmented reality, and other audio/visual displays to the device of the user that is predictably useful and relevant to the user'"'"'s current context and future context as the user enters a new context.

Claims

1. A computer-implemented process for providing predictably useful, contextually intelligent information to a first user as said first user moves from a first user current context to a first user new context comprising:

providing a first user mobile communication device;

associating said device with a first user;

providing a server that is in communication with said device;

providing a relationship management system that resides in said server and populating said relationship management system with historical demographic data for said first user;

providing sensor input data from said first user mobile communication device to said server when said first user is in said first user current context;

said sensor input data including;

data corresponding to a current location of said first user mobile communication device and at least data corresponding to one or more of the group consisting of;

current activity of said first user, mental state of said first user, physical state of said first user, mode of travel of said first user, direction of travel of said first user, speed of travel of said first user, level of engagement of said first user in said first user current context, surrounding environment of said first user in said first user current context, identity of one or more persons in addition to said first user and who are nearby said first user in said first user current context, identity of at least one mobile device other than said first user mobile communication device and that is nearby said first user mobile communication device in said first user current context;

providing said sensor input data from said first user mobile communication device to create acquired first user current data;

capturing, by said first user mobile communication device through an image recognition application, real-time image data to create first user captured real-time image data for said first user current context;

generating first user current contextual data for said first user from said acquired first user current data and from said first user captured real-time image data for said first user current context;

gathering said first user current contextual data to create said first user current contextual data corresponding to said first user'"'"'s current context;

uploading said first user current contextual data corresponding to said first user'"'"'s current context via a wide area mobile communication network to said server;

matching said first user current contextual data corresponding to said first user'"'"'s current context with said first user historical, demographic and environmental data;

combining and processing in the relationship management system the first user current contextual data, current environmental data and historical demographic data to define a message relevant to the first user while the first user is in the current context;

generating feedback data for said first user that is contextually relevant to said first user'"'"'s current context and that is predictably useful to said first user as said first user enters a said new context to form first user useful feedback data; and

,

transmitting to and displaying on said first user mobile communication device said first user useful feedback data to provide said contextually intelligent mobile information.

2. The process of claim 1 wherein said first user current contextual data and said feedback data are communicated between said first user mobile communication device and said server.

3. The process of claim 1 further comprising:

providing at least one additional mobile communication device;

associating each additional mobile communication devices with an additional user; and

,

wherein each additional mobile communication device is able to communicate with each other additional mobile communication device, with said first user mobile communication device and with said server.

4. The process of claim 1 further comprising:

providing mobile communication equipment;

providing at least one additional mobile communication device;

associating each additional mobile communication devices with an additional user; and

,

wherein each additional mobile communication devices is able to communicate with each other additional mobile communication device;

with said first user mobile communication device, with said mobile communication equipment and with said server.

5. The process of claim 1 further creating a sphere of influence context bubble for n+1 users, where n is an integer, by:

providing an additional mobile communication device for each of n additional users, each additional user having a current context;

associating each said additional mobile communication device with each corresponding one of said n additional users;

generating current contextual data for each one of said n additional users by;

populating said relationship management system with historical and demographic data for each one of said n additional users;

providing sensor input data from each of said n additional user'"'"'s mobile communication device to said server for each of said n additional user when said n additional user'"'"'s communication device is in proximity to said first user'"'"'s mobile communication device;

said sensor input data including;

data corresponding to a current location of each one of said n additional user mobile communication devices and at least data corresponding to one or more of the group consisting of;

current activity of each one of said n additional users, mental state of each one of said n additional users, physical state of each one of said n additional users, mode of travel of each one of said n additional users, direction of travel of each one of said n additional users, speed of travel of each one of said n additional users, level of engagement of each one of said n additional users in said first user current context, surrounding environment of each one of said n additional users in said first user current context, identity of one or more persons in addition to said first user and who are nearby said first user in said first user current context, identity of at least one mobile device other than said first user mobile communication device and that is nearby said first user mobile communication device in said first user current context;

providing sensor input data from each one of said n additional mobile communication devices to create acquired user current data for each one of said additional users;

capturing, by each of said n additional user mobile communication devices through an image recognition application, real-time image data to create n additional user captured real-time image data for each one of said n additional user'"'"'s current context;

generating for each of said n additional users current contextual data from said acquired n additional user current data and from said n additional user captured real-time image data for each one of said n additional user'"'"'s current context;

gathering said current contextual data for each of said n additional users to create for each of said additional user'"'"'s current contextual data corresponding to each of said n additional user'"'"'s current context;

uploading said n additional user'"'"'s current contextual data corresponding to each of said n additional user'"'"'s current context via a wide area mobile communication network to said server;

establishing communication among said first user mobile communication device, said server and any of said n additional mobile communication devices when said first user mobile communication device is in proximity to any of said n additional communication devices.

6. The process of claim 1 further comprising:

creating a sphere of influence context bubble for n+1 users, where n is an integer, by;

providing n additional mobile communication devices for n additional users, each additional user having a current context;

associating each of said n additional mobile communication devices with at least one of the n additional users;

generating current contextual data for each one of the n additional users; and

,

establishing communication among any of said n+1 user mobile communication devices, said server and any of said n additional mobile communication devices when any of said n+1 communication devices is in proximity to any other of said n+1 communication devices.

7. The process of claim 1 further comprising:

providing m current context input devices, where m is an integer, said m current context input devices comprise any of the following types of devices;

augmented reality glasses;

augmented reality displays;

interactive displays;

vending machines with interactive displays;

fixtures and product displays that incorporate interactive and connected devices that include image recognition capability;

headphones;

sensors that transmit real-time sounds;

sensors that transmit real-time images;

sensors that transmit current data about the physical condition of the first user; and

,

devices that provide any of the first user'"'"'s acquired first user current data.

8. The process of claim 1 wherein the first user mobile communication device comprises any of a smart phone, a tablet, augmented reality glasses, contact lenses, personal communication hubs, connected clothing, connected jewelry, connected shoes, connected accessories and any embedded communication device.

9. The process of claim 1 wherein the first user mobile communication device includes a sensor that comprises any device capable of sensing and providing to the first user mobile communication device data representative of any of a location, a time, an activity, a speed of travel, a direction of travel, an anxiety level, a social media status, a gender, a relationship status, an ambient sound, an ambient light level, an air quality or other environmental aspect in proximity to the first user.

10. The process of claim 1 wherein the first user mobile communication device includes a sensor that comprises any device capable of image recognition and of providing to the first user mobile communication device data representative of the image recognized.

11. The process of claim 1 wherein the first user mobile communication device includes a sensor that comprises an image recognition system capable of capturing and providing to the first user communication device data representative of any of a product, image, ad, video, TV broadcast, billboard, poster, and other display with which the first user is interacting.

12. The process of claim 1 wherein the first user mobile communication device includes a sensor comprises any device capable of providing augmented reality data to the first user mobile communication device.

13. The process of claim 1 wherein said contextual data comprises data representative of any of activity, location, mental state, physical state, mode direction of travel, speed of travel and level of engagement of the first user in an activity.

14. The process of claim 1 wherein said contextual data comprises data representative of any of the first user'"'"'s surrounding environment, a nearby other person'"'"'s surrounding environment and a nearby other mobile device'"'"'s surrounding environment.

15. The process of claim 14 wherein said nearby other mobile device comprises any of other connected devices, equipment, vehicles, tools, computers, displays, point of sale systems, ticketing systems, inventory systems, video and audio capture sensors, ball(s), object and other tracking systems and other sensor system(s), devices and equipment that have capability to communicate via a wide area network or any other methodology directly to one or more end users through a back-end cloud based network connected to a cellular or WiFi network or any future method of communication capable of such communication.

16. The process of claim 1 further comprising updating said first user'"'"'s current contextual data and said first user'"'"'s environmental data as the first user enters said new context, and so on as the first user continues to move from said new context to another context.

17. The process of claim 1

wherein said relationship management system further includes content comprising any of offers, videos, audio files, augmentations, 3D models, games, coupons and advice.

18. The process of claim 1 wherein said message comprises any of feedback information, experiences, recommendations, offers, coupons, advice, tactile feedback, visual and audio representations, augmented and audio/visual displays.