Contextual based information aggregation system

• US 9,679,068 B2
• Filed: 02/02/2015
• Issued: 06/13/2017
• Est. Priority Date: 06/17/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Saretto, Cesare John, Kinnebrew, Peter Tobias, Kamuda, Nicholas Ferianc, Somuah, Henry Hooper, Hebenthal, Douglas C., McCloskey, Matthew John, Mulcahy, Kathleen P.
• Primary Examiner(s): WHIPPLE, BRIAN P
• Application Number:
  US14/612,169
• Publication Number:
  US 20150149288A1
• Time in Patent Office: 862 Days
• Field of Search: None
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 30/0259 based on store location
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/44226 on social networks
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
• CPC Class Codes: H04W 4/185 by embedding added-value information into content, e.g. geo-tagging
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

A system automatically and continuously finds and aggregates the most relevant and current information about the people and things that a user cares about. The information gathering is based on current context (e.g., where the user is, what the user is doing, what the user is saying/typing, etc.). The result of the context based information gathering is presented ubiquitously on user interfaces of any of the various physical devices operated by the user.

Claims

1. A smartphone, comprising:

a camera;

a communication interface;

a user interface; and

a processor in communication with the camera, the communication interface and the user interface;

wherein the processor is configured to access a photograph from the camera and send the photograph to a remote server via a network and the communication interface in order for the server to automatically recognize an object in the photograph including recognizing an image of the object and determining the model of the object and identify a retail offering of sale of the object, wherein the processor is configured to receive a communication from the server via the communication interface that identifies the retail offering of sale of the object based on the image; and

wherein the processor is configured to report the retail offering of sale of the object based on the image via the user interface.

2. The smartphone of claim 1, wherein:

the camera captures the photograph automatically.

3. The smartphone of claim 1, wherein:

the processor is configured to obtain context information for the smartphone and transmit the context information to the remote server.

4. The smartphone of claim 1, wherein:

the processor is configured to obtain user interest information for the smartphone and transmit the user interest information to the remote server.

5. A method for delivering content, comprising:

accessing a photograph taken with a mobile device;

automatically recognizing an object in the photograph, the automatically recognizing the object in the photograph includes recognizing an image of the object and determining the model of the object;

searching for information about the recognized object and identifying a retail offering of sale of the object; and

reporting the retail offering of sale of the object.

6. The method of claim 5, wherein:

the automatically recognizing the object in the photograph includes recognizing an image that is not predetermined.

7. The method of claim 5, wherein:

the accessing, recognizing, searching, identifying and reporting is performed by a server system remote from the mobile device.

8. The method of claim 7, further comprising:

receiving the photograph at the server system remote from the mobile device.

9. The method of claim 8, further comprising:

receiving context information at the server system from the mobile device; and

filtering results of the searching at the server system based on the received context information.

10. The method of claim 5, wherein:

the reporting includes transmitting information to the mobile device that indicates the retail offering of sale of the object.

11. The method of claim 5, wherein:

the mobile device is a cell phone.

12. The method of claim 5, wherein:

the accessing, recognizing, and searching is performed without a request by the user.

13. An aggregation system, comprising:

a data store; and

one or more computers in communication with the data store, wherein the one or more computers are configured to receive a photograph from a mobile device and automatically recognize an image of an item in the received photograph and determine a model of the item, such that the recognized item is something that can be purchased, wherein the one or more computers are configured to search for information about the recognized item and identify a retail offering of sale of the item, and wherein the one or more computers are configured to electronically report to the mobile device the retail offering of sale of the object.

14. The aggregation system of claim 13, wherein:

the one or more computers are configured to search for information about the item on the Internet.

15. The aggregation system of claim 13, wherein:

the one or more computers are configured to receiving context information from the mobile device and use the context information to identify the retail offering of sale of the item.