Sychronized display of street view map and video stream
First Claim
1. A computer-implemented method for displaying location imagery in context with a video stream, the method comprising:
- extracting locational metadata from a set of video data, the video data comprising a plurality of frames;
identifying a set of geographic locations associated with the plurality of frames based on the locational metadata;
generating a set of location imagery associated with the set of geographic locations, the location imagery comprising a set of map features;
displaying the set of map features of the set of location imagery as an overlay superimposed over the plurality of frames wherein the set of map features of the overlay annotate in frame the set of geographic locations associated with the plurality of frames;
synchronizing the overlay of the set of map features to the plurality of frames based on the set of geographic locations, the synching comprising;
playing a set of frames of the plurality of frames; and
displaying, in time with the playing, the overlay of the set of map features annotating the geographic location of each of the played set of frames;
configuring the set of location imagery to comprise a set of map features associated with a geographic location adjacent to the set of geographic locations associated with the plurality of frames, the adjacent geographic location not being associated with the plurality of frames;
connecting the set of map features associated with the geographic location adjacent to the set of geographic locations associated with the plurality of frames to the overlay of the set of map features annotating the geographic location of at least one of the played set of frames; and
permitting, in response to a user interaction, navigation of the location imagery beyond the set of location imagery associated with the set of geographic locations associated with the plurality of frames by permitting navigation of the set of map features associated with the geographic location adjacent to the set of geographic locations associated with the plurality of frames.
1 Assignment
0 Petitions
Accused Products
Abstract
Approaches presented herein enable displaying of a street view or map in the context of a video stream object. Specifically, captured video is analyzed for a plurality of geo-coordinate and direction metadata associated with frames of the video. The video may also be analyzed for visual indicia of location or direction. A user watching the video selects an object therein, which may be then identified by its coordinates and labeled for the user. A map or street view corresponding to the selected object is shown synchronized to the video (e.g., in a side-by-side view), based on the geo-coordinate and direction metadata associated with the video frames. The synchronized video and map speed may be manipulated. The video may also be broken up by frames, and the user permitted to navigate beyond the bounds of the video, where frames are played when the user navigates to areas within the video.
17 Citations
20 Claims
-
1. A computer-implemented method for displaying location imagery in context with a video stream, the method comprising:
-
extracting locational metadata from a set of video data, the video data comprising a plurality of frames; identifying a set of geographic locations associated with the plurality of frames based on the locational metadata; generating a set of location imagery associated with the set of geographic locations, the location imagery comprising a set of map features; displaying the set of map features of the set of location imagery as an overlay superimposed over the plurality of frames wherein the set of map features of the overlay annotate in frame the set of geographic locations associated with the plurality of frames; synchronizing the overlay of the set of map features to the plurality of frames based on the set of geographic locations, the synching comprising; playing a set of frames of the plurality of frames; and displaying, in time with the playing, the overlay of the set of map features annotating the geographic location of each of the played set of frames; configuring the set of location imagery to comprise a set of map features associated with a geographic location adjacent to the set of geographic locations associated with the plurality of frames, the adjacent geographic location not being associated with the plurality of frames; connecting the set of map features associated with the geographic location adjacent to the set of geographic locations associated with the plurality of frames to the overlay of the set of map features annotating the geographic location of at least one of the played set of frames; and permitting, in response to a user interaction, navigation of the location imagery beyond the set of location imagery associated with the set of geographic locations associated with the plurality of frames by permitting navigation of the set of map features associated with the geographic location adjacent to the set of geographic locations associated with the plurality of frames. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for displaying location imagery in context with a video stream, the computer system comprising:
-
a memory medium comprising program instructions; a bus coupled to the memory medium; and a processor for executing the program instructions, the instructions causing the system to; extract locational metadata from a set of video data, the video data comprising a plurality of frames; identify a set of geographic locations associated with the plurality of frames based on the locational metadata; generate a set of location imagery associated with the set of geographic locations, the location imagery comprising a set of map features; display the set of map features of the set of location imagery as an overlay superimposed over the plurality of frames wherein the set of map features of the overlay annotate in frame the set of geographic locations associated with the plurality of frames; synchronize the overlay of the set of map features to the plurality of frames based on the set of geographic locations by causing the system to; play a set of frames of the plurality of frames; and display, in time with the playing, the overlay of the set of map features annotating the geographic location of each of the played set of frames; configure the set of location imagery to comprise a set of map features associated with a geographic location adjacent to the set of geographic locations associated with the plurality of frames, the adjacent geographic location not being associated with the plurality of frames; connect the set of map features associated with the geographic location adjacent to the set of geographic locations associated with the plurality of frames to the overlay of the set of map features annotating the geographic location of at least one of the played set of frames; and permit, in response to a user interaction, navigation of the location imagery beyond the set of location imagery associated with the set of geographic locations associated with the plurality of frames by permitting navigation of the set of map features associated with the geographic location adjacent to the set of geographic locations associated with the plurality of frames. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer program product for displaying location imagery in context with a video stream, the computer program product comprising a computer readable storage device, and program instructions stored on the computer readable storage device, to:
-
extract locational metadata from a set of video data, the video data comprising a plurality of frames; identify a set of geographic locations associated with the plurality of frames based on the locational metadata; generate a set of location imagery associated with the set of geographic locations, the location imagery comprising a set of map features; display the set of map features of the set of location imagery as an overlay superimposed over the plurality of frames wherein the set of map features of the overlay annotate in frame the set of geographic locations associated with the plurality of frames; and synchronize the overlay of the set of map features to the plurality of frames based on the set of geographic locations by causing the system to; play a set of frames of the plurality of frames; and display, in time with the playing, the overlay of the set of map features annotating the geographic location of each of the played set of frames configure the set of location imagery to comprise a set of map features associated with a geographic location adjacent to the set of geographic locations associated with the plurality of frames, the adjacent geographic location not being associated with the plurality of frames; connect the set of map features associated with the geographic location adjacent to the set of geographic locations associated with the plurality of frames to the overlay of the set of map features annotating the geographic location of at least one of the played set of frames; and permit, in response to a user interaction, navigation of the location imagery beyond the set of location imagery associated with the set of geographic locations associated with the plurality of frames by permitting navigation of the set of map features associated with the geographic location adjacent to the set of geographic locations associated with the plurality of frames. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification