Embedding location information in a media collaboration using natural language processing

• US 10,146,748 B1
• Filed: 09/10/2014
• Issued: 12/04/2018
• Est. Priority Date: 09/10/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Barndollar, Eric W., Eidelson, Aaron, Meyers, Holger
• Primary Examiner(s): Dyer, Andrew R
• Application Number:
  US14/482,421
• Time in Patent Office: 1,546 Days
• Field of Search: 715205, 715230, 715231, 715233
• CPC Class Codes: G06F 16/444 Spatial browsing, e.g. 2D maps, 3D or virtual spaces
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 40/134 Hyperlinking
• CPC Class Codes: G06F 40/279 Recognition of textual entities
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/222 using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

Systems and methods are disclosed for embedding location information in a media collaboration using natural language processing. A method includes identifying, using natural language processing (NLP) techniques, a location discussed by one or more users in a media collaboration, determining a location context of at least one of the one or more users, the location context comprising a geographic location of a device of the at least one user, identifying, based on the identified location and the location context, location information corresponding to the identified location, and providing access to the location information in the media collaboration.

Claims

1. A method comprising:

identifying, using natural language processing (NLP) techniques, a location discussed by users in a media collaboration, the media collaboration comprising a composite media stream generated from combining media streams transmitted from devices of the users;

determining a location context of at least one user of the users, the location context comprising a geographic location of a device of the at least one user;

identifying, based on the identified location and the location context, location information comprising a map corresponding to the identified location;

generating, without user intervention, a preview of the location information identified using the NLP techniques, the preview comprising the map and a user interface (UI) element, the UI element to confirm sharing of the location information within the media collaboration;

providing, without user intervention, the preview to the at least one user via a graphical user interface (GUI) of the media collaboration, the preview provided in a conversation portion of the GUI of the media collaboration without being visible to other users in the conversation portion of the GUI of the media collaboration;

responsive to receiving an indication to share the location information via the UI element of the preview, providing, by a processing device to the other users, the location information comprising the map within the media collaboration; and

responsive to receiving an indication that sharing of the location information is declined, removing the preview without sharing the location information in the media collaboration.

2. The method of claim 1, wherein the location comprises a place.

3. The method of claim 2, wherein the place comprises at least one of a business, a home, a destination, or a school.

4. The method of claim 1, wherein the location information further comprises at least one of an address, latitude and longitude coordinates, navigation options, reviews, website link, application link, images, animations, music, or videos.

5. The method of claim 1, wherein the location context is determined based on at least one of global positioning system (GPS) data, cellular data signals, sensor data, Wi-Fi signals, internet protocol (IP) addresses, web application programming interface (API) input, or direct input from the at least one user.

6. The method of claim 1, wherein including the location information further comprises embedding a selectable link to the location information in the media collaboration.

7. The method of claim 1, wherein the indication to share comprises permission from the at least one user to share the location information with other users in the media collaboration.

8. The method of claim 7, wherein the at least one user is a user that initially discussed the location.

9. The method of claim 1, wherein the media collaboration comprises at least one of a live video recording, a pre-recorded video, a video chat, or a text-based chat.

10. A system comprising:

a memory; and

a processing device communicatively coupled to the memory, wherein the processing device is to;

identify, using natural language processing (NLP) techniques, a location discussed by users in a media collaboration, the media collaboration comprising a composite media stream generated from combining media streams transmitted from devices of the users;

determine a location context of at least one user of the users, the location context comprising a map depicting a geographic location of a device of the at least one user;

identify, based on the identified location and the location context, location information corresponding to the identified location;

generate, without user intervention, a preview of the location information identified using the NLP techniques, the preview comprising the map and a user interface (UI) element, the UI element to confirm sharing of the location information within the media collaboration;

provide, without user intervention, the preview to the at least one user via a graphical user interface (GUI) of the media collaboration, the preview provided in a conversation portion of the GUI of the media collaboration without being visible to other users in the conversation portion of the GUI of the media collaboration;

responsive to receiving an indication to share the location information via the UI element of the preview, provide, to the other users, the location information comprising the map within the media collaboration; and

responsive to receiving an indication that sharing of the location information is declined, remove the preview without sharing the location information in the media collaboration.

11. The system of claim 10, wherein the location comprises a place.

12. The system of claim 10, wherein the location information comprises at least one of a map, an address, latitude and longitude coordinates, navigation options, reviews, website link, application link, images, animations, music, or videos.

13. The system of claim 10, wherein the location context is determined based on at least one of global positioning system (GPS) data, cellular data signals, sensor data, Wi-Fi signals, internet protocol (IP) addresses, web application programming interface (API) input, or direct input from the at least one user.

14. The system of claim 10, wherein the processing device to include the location information further comprises the processing device to embed a selectable link to the location information in the media collaboration.

15. The system of claim 10, wherein the indication to share comprises permission from the at least one user to share the location information with other users in the media collaboration.

16. The system of claim 10, wherein the media collaboration comprises at least one of a live video recording, a pre-recorded video, a video chat, or a text-based chat.

17. A non-transitory computer-readable storage medium having instructions stored thereon that, when executed by a processing device, cause the processing device to perform operations comprising:

identifying, using natural language processing (NLP) techniques, a location discussed by users in a media collaboration, the media collaboration comprising a composite media stream generated from combining media streams transmitted from devices of the users;

determining a location context of at least one user of the users, the location context comprising a geographic location of a device of the at least one user;

identifying, based on the identified location and the location context, location information comprising a map corresponding to the identified location;

generating, without user intervention, a preview of the location information identified using the NLP techniques, the preview comprising the map and a user interface (UI) element, the UI element to confirm sharing of the location information within the media collaboration;

providing, without user intervention, the preview to the at least one user via a graphical user interface (GUI) of the media collaboration, the preview provided in a conversation portion of the GUI of the media collaboration without being visible to other users in the conversation portion of the GUI of the media collaboration;

responsive to receiving an indication to share the location information via the UI element of the preview, providing, by the processing device to the other users, the location information comprising the map within the media collaboration; and

responsive to receiving an indication that sharing of the location information is declined, removing the preview without sharing the location information in the media collaboration.

18. The non-transitory computer-readable storage medium of claim 17, wherein the location information comprises at least one of a map, an address, latitude and longitude coordinates, navigation options, reviews, website link, application link, images, animations, music, or videos.

19. The non-transitory computer-readable storage medium of claim 17, wherein the location context is determined based on at least one of global positioning system (GPS) data, cellular data signals, sensor data, Wi-Fi signals, internet protocol (IP) addresses, web application programming interface (API) input, or direct input from the at least one user.

20. The non-transitory computer-readable storage medium of claim 17, wherein including the location information further comprises embedding a selectable link to the location information in the media collaboration.

21. The non-transitory computer-readable storage medium of claim 17, wherein the indication to share comprises permission from the at least one user to share the location information with other users in the media collaboration.

22. The non-transitory computer-readable storage medium of claim 17, wherein the media collaboration comprises at least one of a live video recording, a pre-recorded video, a video chat, or a text-based chat.

23. A user device comprising:

a display device;

a memory; and

a processing device communicably coupled to the display device and the memory, wherein the processing device to execute instruction from the memory to cause the processing device to perform operations comprising;

providing, via a graphical user interface (GUI) displayed on the display device, a media collaboration, the media collaboration comprising a composite media stream generated from combining media streams transmitted from devices of users;

providing, via the GUI, a communication associated with a location as part of the media collaboration;

receiving embedded location information comprising a map corresponding to the location, the location identified using natural language processing (NLP) techniques on the communication and location association techniques to identify the location information;

receiving, without user intervention, a preview of the location information identified using the NLP techniques, the preview comprising the map and a user interface (UI) element, the UI element to confirm sharing of the location information within the media collaboration;

providing, without user intervention, the preview via a graphical user interface (GUI) of the media collaboration, the preview provided in a conversation portion of the GUI of the media collaboration without being visible to other users in the conversation portion of the GUI of the media collaboration, wherein the user is associated with the user device;

responsive to receiving an indication to share the location information via the UI element of the preview, providing, via the GUI, the embedded location information comprising the map as part of the media collaboration and visible within the media collaboration to the other users; and

responsive to receiving an indication that sharing of the location information is declined, removing the preview from the GUI without sharing the location information in the media collaboration.

24. The user device of claim 23, wherein the location information comprises at least one of a map, an address, latitude and longitude coordinates, navigation options, reviews, website link, application link, images, animations, music, or videos.

25. The user device of claim 23, wherein the location association techniques utilize the location and a location context of one or more users of the media collaboration to identify the location information, wherein the location context is determined based on at least one of global positioning system (GPS) data, cellular data signals, sensor data, Wi-Fi signals, internet protocol (IP) addresses, web application programming interface (API) input, or direct input from the at least one user.