View of a physical space augmented with social media content originating from a geo-location of the physical space

• US 9,317,600 B2
• Filed: 03/17/2014
• Issued: 04/19/2016
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Tai Technologies Inc. (Crisis24)
• Original Assignee: Geofeedia, Inc.
• Inventors: Harris, Philip B., Mitchell, Scott K., Mulroy, Michael J.
• Primary Examiner(s): SOMERS, MARC S
• Application Number:
  US14/215,612
• Publication Number:
  US 20140280278A1
• Time in Patent Office: 764 Days
• Field of Search: 707/706, 707/758, 345/8
• US Class Current: 1/1
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/18 Commands or executable codes
• CPC Class Codes: H04L 51/52 for supporting social networking services

Abstract

The disclosure relates to systems and methods for augmenting a view of a physical space of one or more geographically definable locations (“geo-locations”) with social media and/or other content originating from the one or more geo-locations. Generally speaking, the system may include a computing device having one or more processors programmed to augment (e.g., add to, overlay, embed, etc.) the view of the physical space of a geo-location with social media content, thereby allowing a user to view a physical space at a geo-location along with social media content that was created from the geo-location.

Claims

1. A system for augmenting a view of a physical space at a geographically definable location with social media content originating from the geographically definable location, wherein the augmented view includes an augmented space that is coincident with the physical space, the system comprising:

one or more processors programmed by one or more computer program instructions that, when executed by the one or more processors, cause the one or more processors to;

obtain (i) a real-time or stored image of a physical space corresponding to a geographically definable location and (ii) reality contextual information that describes a context of the physical space, wherein the one or more processors are programmed to obtain the reality contextual information from one or more sensors that provide one or more sensor measurements with respect to the physical space, and wherein the one or more sensor measurements relate to an orientation of a first device that includes the one or more sensors, an ambient condition around the first device, and/or an altitude of the first device;

identify the geographically definable location associated with the physical space;

generate a first request to be provided to a first social media content provider, wherein the first request formats the geographically definable location in a first format specific to the first social media content provider;

generate a second request to be provided to a second social media content provider, wherein the second request formats the geographically definable location in a second format specific to the second social media content provider, the second format being different than the first format;

obtain at least a first social media content item relevant to the geographically definable location based on the first formatted request, and first content contextual information that describes a context in which the first social media content item was created;

obtain at least a second social media content item relevant to the geographically definable location based on the second formatted request, and second content contextual information that describes a context in which the second social media content item was created;

compare the reality contextual information with the first content contextual information;

determine whether there exists a first match between at least some of the reality contextual information and the first content contextual information, wherein the first match indicates a match between the context of the physical space and the context in which the first social media content item was created;

compare the reality contextual information with the second content contextual information;

determine whether there exists a second match between at least some of the reality contextual information and the second content contextual information, wherein the second match indicates a match between the context of the physical space and the context in which the second social media content item was created;

cause a first graphical representation of the first social media content item to be included in the augmented space responsive to a determination that there exists the first match between at least some of the reality contextual information and the first content contextual information, wherein the augmented space is coincident with the physical space such that the view is augmented with the augmented space;

cause a second graphical representation of the second social media content item to be included in the augmented space responsive to a determination that there exists the second match between at least some of the reality contextual information and the second content contextual information;

cause the augmented view to be provided to the first device;

obtain a second orientation of a second device used to create the first social media content item based on the first content contextual information;

determine that the second orientation is different than the orientation of the first device such that the graphical representation of the first social media content item is not in the augmented view; and

cause an indication to be provided on the augmented view associated with the physical space that indicates a direction in which to move the device to match the second orientation to bring the first graphical representation of the first social media content item into the augmented view.

2. The system of claim 1, wherein the one or more sensor measurements relate to an altitude of a device that includes the one or more sensors, and wherein the one or more processors are programmed to:

determine that the first social media content item was created at an altitude that is the same as the altitude of the device.

3. The system of claim 1, wherein the one or more sensor measurements relate to an ambient condition of a device that includes the one or more sensors, and wherein the one or more processors are programmed to:

determine that the first social media content item was created at an ambient condition that is the same as the ambient condition of the device.

4. The system of claim 1, wherein the one or more sensor measurements relate to an altitude of a device that includes the one or more sensors and an ambient condition related to the device, and wherein the one or more processors are programmed to:

determine that the first social media content item was created at an altitude that is the same as the altitude of the device; and

determine that the first social media content item was created at an ambient condition that is the same as the ambient condition of the device.

5. The system of claim 1, wherein the image of the physical space comprises a stored image.

6. The system of claim 1, wherein the one or more processors are further programmed to:

identify a structure within the physical space;

obtain altitude information of the structure based on the reality contextual information;

identify at least one floor of the structure based on the altitude information, wherein the first content contextual information indicates that the first social media content item was created from the at least one floor of the structure; and

wherein to cause the first graphical representation of the first social media content item to be included in the augmented space, the one or more physical processors are further programmed to cause the first graphical representation of the first social media content item to be included in the augmented space in association with the at least one floor of the structure in the augmented view.

7. The system of claim 1, wherein the one or more processors are further programmed to:

receive one or more parameters used to filter in or out social media content items, wherein the first formatted request specifies the one or more parameters.

8. A method for augmenting a view of a physical space at a geographically definable location with social media content originating from the geographically definable location, wherein the augmented view includes an augmented space that is coincident with the physical space, the method being implemented on a computer having one or more processors programmed with one or more computer program instructions that, when executed by the one or more processors, cause the computer to perform the method, the method comprising:

obtaining, by the computer, (i) a real-time or stored image of a physical space corresponding to a geographically definable location, and (ii) reality contextual information that describes a context of the physical space, wherein the reality contextual information is obtained from one or more sensors that provide one or more sensor measurements with respect to the physical space, and wherein the one or more sensor measurements relate to an orientation of a first device that includes the one or more sensors, an ambient condition around the first device, and/or an altitude of the first device;

identifying, by the computer, the geographically definable location associated with the physical space;

generating, by the computer, a first request to be provided to a first social media content provider, wherein the first request formats the geographically definable location in a first format specific to the first social media content provider;

generating, by the computer, a second request to be provided to a second social media content provider, wherein the second request formats the geographically definable location in a second format specific to the second social media content provider, the second format being different than the first format;

obtaining, by the computer, at least a first social media content item relevant to the geographically definable location based on the first formatted request, and first content contextual information that describes a context in which the first social media content item was created;

obtaining, by the computer, at least a second social media content item relevant to the geographically definable location based on the second formatted request, and second content contextual information that describes a context in which the second social media content item was created;

comparing, by the computer, the reality contextual information with the first content contextual information;

determining, by the computer, whether there exists a first match between at least some of the reality contextual information and the first content contextual information, wherein the first match indicates a match between the context of the physical space and the context in which the first social media content item was created;

comparing, by the computer, the reality contextual information with the second content contextual information;

determining, by the computer, whether there exists a second match between at least some of the reality contextual information and the second content contextual information, wherein the second match indicates a match between the context of the physical space and the context in which the second social media content item was created;

causing, by the computer, a first graphical representation of the first social media content item to be included in the augmented space responsive to a determination that there exists the first match between at least some of the reality contextual information and the first content contextual information, wherein the augmented space is coincident with the physical space such that the view is augmented with the augmented space;

causing, by the computer, a second graphical representation of the second social media content item to be included in the augmented space responsive to a determination that there exists the second match between at least some of the reality contextual information and the second content contextual information;

causing, by the computer, the augmented view to be provided to the first device;

obtaining, by the computer, a second orientation of a second device used to create the first social media content item based on the first content contextual information;

determining, by the computer, that the second orientation is different than the orientation of the first device such that the graphical representation of the first social media content item is not in the augmented view; and

causing, by the computer, an indication to be provided on the augmented view that indicates a direction in which to move the device to match the second orientation to bring the first graphical representation of the first social media content item into the augmented view.

9. The method of claim 8, wherein the one or more sensor measurements relate to an altitude of a device that includes the one or more sensors, and wherein the method further comprising:

determining, by the computer, that the first social media content item was created at an altitude that is the same as the altitude of the device.

10. The method of claim 8, wherein the one or more sensor measurements relate to an ambient condition of a device that includes the one or more sensors, and wherein the method further comprising:

determining, by the computer, that the first social media content item was created at an ambient condition that is the same as the ambient condition of the device.

11. The method of claim 8, wherein the one or more sensor measurements relate to an altitude of a device that includes the one or more sensors and an ambient condition related to the device, and wherein the method further comprising:

determining, by the computer, that the first social media content item was created at an altitude that is the same as the altitude of the device; and

determining, by the computer, that the first social media content item was created at an ambient condition that is the same as the ambient condition of the device.

12. The method of claim 8, wherein the one or more processors are further programmed to:

receive an indication that the first device has been moved to be in the second orientation; and

cause the first graphical representation of the first social media content item to be provided into the augmented view responsive to the indication that the device has been moved to be in the second orientation.