Interactive video multi-screen experience on mobile phones

• US 10,223,060 B2
• Filed: 08/22/2016
• Issued: 03/05/2019
• Est. Priority Date: 08/22/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Karacas, Peter, Sowden, James, Lorrain, Matthieu, Rodman, Bryan
• Primary Examiner(s): Natnael, Paulos M
• Application Number:
  US15/243,877
• Publication Number:
  US 20180052650A1
• Time in Patent Office: 925 Days
• Field of Search: 725 61, 725 68, 725143, 725 43, 725 39, 725 37, 348 1403, 348 1416, 348564, 348629, 348838, 348158, 34820815, 348376, 348520, 348530, 348540, 348553, 348569
• CPC Class Codes: G06F 3/1431 using a single graphics controller
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G06T 3/20 Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/04 Display device controller operating with a plurality of display units
• CPC Class Codes: G09G 2360/121 using a cache memory
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: G09G 2370/025 LAN communication management
• CPC Class Codes: G09G 5/346 for systems having a bit-mapped display memory
• CPC Class Codes: H04N 1/3876 Recombination of partial images to recreate the original image
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection

Abstract

Video content items representing a video may be provided to a group of mobile devices to present the video on a combined display screen of the mobile devices. An indication of a user interaction performed at one of the mobile devices with respect to a corresponding video content item of the plurality of video content items that has been provided to the one of the mobile devices may be received. An action to change a display of other video content items of the video content items provided to other mobile devices of the group based on the indication of the user interaction with respect to the corresponding video content item may be determined. The action may be provided to the other mobile devices of the group to change the display of the other video content items provided to the other mobile devices of the group.

Claims

1. A method comprising:

providing a plurality of video content items representing a video to a group of mobile devices to collectively present the video on a combination of display screens of the mobile devices of the group;

receiving an indication of a user interaction corresponding to a panning action performed with respect to a corresponding video content item of the plurality of video content items that has been provided to one of the mobile devices of the group of mobile devices;

determining, by a processing device, an action to change a display of other video content items of the video content items provided to other mobile devices of the group based on a direction of the panning action performed with respect to the corresponding video content item provided to the one of the mobile devices; and

providing the determined action to the other mobile devices of the group of mobile devices to change the display of the other video content items provided to the other mobile devices of the group.

2. The method of claim 1, wherein the action to the other mobile devices of the group specifies the panning action to be performed for each of the other video content items provided to the other mobile devices based on the direction of the panning of the corresponding video content item.

3. The method of claim 1, wherein the panning of the corresponding video content item corresponds to a horizontal scrolling of the display of the corresponding video content item.

4. The method of claim 1, wherein each of the video content items comprises at least one overlap region with another video content item, and wherein the panning of the corresponding video content item corresponds to changing the display of the corresponding video content item to display at least a portion of the overlap region.

5. The method of claim 1, wherein the determining of the action to change the other video content items comprises:

identifying an amount of the panning of the corresponding video content item that has been provided to the one of the mobile devices, wherein the determining of the action is further based on the amount of the panning.

6. A non-transitory machine-readable storage medium storing instructions which, when executed, cause a processing device to perform operations comprising:

providing a plurality of video content items representing a video to a group of mobile devices to collectively present the video on a combination of display screens comprising display screens of the mobile devices of the group;

receiving an indication of a user interaction corresponding to a panning action performed with respect to a corresponding video content item of the plurality of video content items that has been provided to one of the mobile devices of the group of mobile devices;

determining an action to change a display of other video content items of the video content items provided to other mobile devices of the group based on a direction of the panning action performed with respect to the corresponding video content item provided to the one of the mobile devices; and

providing the determined action to the other mobile devices of the group of mobile devices to change the display of the other video content items provided to the other mobile devices of the group.

7. The non-transitory machine-readable storage medium of claim 6, wherein the action to the other mobile devices of the group specifies the panning action to be performed for each of the other video content items provided to the other mobile devices based on the direction of the panning of the corresponding video content item.

8. The non-transitory machine-readable storage medium of claim 6, wherein the panning of the corresponding video content item corresponds to a horizontal scrolling of the display of the corresponding video content item.

9. The non-transitory machine-readable storage medium of claim 6, wherein each of the video content items comprises at least one overlap region with another video content item, and wherein the panning of the corresponding video content item corresponds to changing the display of the corresponding video content item to display at least a portion of the overlap region.

10. The non-transitory machine-readable storage medium of claim 6, wherein to determine the action to change the other video content items, the processing device is further to:

identify an amount of the panning of the corresponding video content item that has been provided to the one of the mobile devices, wherein the determining of the action is further based on the amount of the panning.

11. A system comprising:

a memory; and

a processing device, operatively coupled with the memory, to;

stream a plurality of video content items representing a video to a group of mobile devices to collectively present the video on a combination of display screens of the mobile devices of the group;

receive an indication of a user interaction corresponding to a panning action performed with respect to a corresponding video content item of the plurality of video content items that is being streamed to one of the mobile devices of the group of mobile devices;

determine an action to change the display other video content items of the video content items being streamed to other mobile devices of the group based on a direction of the panning action performed with respect to the corresponding video content item being streamed to the one of the mobile devices; and

change the streaming of the other video content items being streamed to the other mobile devices of the group of mobile devices to change the display of the other video content items at the other mobile devices of the group based on the determined action.

12. The system of claim 11, wherein the action specifies the panning action to be performed for each of the other video content items being streamed to the other mobile devices based on the direction of the panning of the corresponding video content item.

13. The system of claim 11, wherein the panning of the corresponding video content item corresponds to a horizontal scrolling of the display of the corresponding video content item.

14. The system of claim 11, wherein each of the video content items comprises at least one overlap region with another video content item, and wherein the panning of the respective video content item corresponds to changing the display of the corresponding video content item to display at least a portion of the overlap region.