Methods and Devices for Presenting Video Feeds in a User Interface

• US 20180019889A1
• Filed: 07/12/2016
• Published: 01/18/2018
• Est. Priority Date: 07/12/2016
• Status: Active Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Burns, Christopher Charles, Clark, Gregory Cortis
• Granted Patent: US 10,263,802 B2
• Time in Patent Office: Days
• CPC Class Codes: H04L 12/2807 Exchanging configuration information on appliance services in a home automation network arrangements for maintenance or administration involving network analysis for automatically determining the actual topology of a network H04L41/12; hardware or software tools for network management using graphical user interfaces H04L41/22; address allocation H04L61/50
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 12/4625 Single bridge functionality, e.g. connection of two networks over a single bridge
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04L 2012/285 Generic home appliances, e.g. refrigerators

Abstract

The various embodiments described herein include methods, devices, and systems for presenting video feeds in a user interface. In one aspect, a method includes: (1) receiving a request to execute an application for communicating with a plurality of smart devices, including a plurality of cameras; (2) in response to receiving the request, establishing a connection for each of at least a subset of the cameras; (3) identifying a user interface for display to a user via the display, the user interface including a video feed from a particular camera; (4) after identifying the user interface, determining whether a connection has been established for the particular camera; (5) in accordance with a determination that the connection has been established for the particular camera, requesting, via the connection, the video feed for the particular camera; and (6) displaying the user interface with the video feed for the particular camera.

Claims

1. A method, comprising:

at a client device having a display, one or more processors, and memory storing one or more programs for execution by the one or more processors;

receiving a request to execute an application for communicating with a plurality of smart devices, the plurality of smart devices including a plurality of cameras;

in response to receiving the request to execute the application, establishing a preliminary connection for each of at least a subset of the plurality of cameras;

identifying a user interface for display to a user via the display, the user interface including a video feed from a particular camera of the plurality of cameras;

after identifying the user interface for display, determining whether a preliminary connection has been established for the particular camera;

in accordance with a determination that the preliminary connection has been established for the particular camera, requesting, via the preliminary connection, the video feed for the particular camera; and

displaying the user interface with the video feed for the particular camera.

2. The method of claim 1, further comprising:

in accordance with a determination that the preliminary connection has not been established for the particular camera, establishing the preliminary connection for the particular camera; and

requesting, via the preliminary connection, the video feed for the particular camera.

3. The method of claim 1, further comprising:

predicting a display order for the plurality of cameras; and

ranking the plurality of cameras in accordance with the predicted display order;

wherein establishing the preliminary connection for each of at least the subset of the plurality of cameras comprises establishing the preliminary connection for each of at least the subset of the plurality of cameras based on the ranking.

4. The method of claim 1, wherein the identified user interface includes a plurality of video players for simultaneous display to the user, and the method further comprises:

determining that video feeds from a first subset of cameras of the plurality of cameras are to be displayed within the identified user interface, the first subset of cameras including the particular camera; and

assigning a video feed from each camera of the first subset of cameras to a video player of the plurality of video players, including assigning the video feed from the particular camera to a particular video player;

wherein displaying the user interface with the video feed comprises displaying a first view of the user interface including video feeds from each camera of the first subset of cameras.

5. The method of claim 4, further comprising, for each camera in the first subset of cameras:

determining whether a preliminary connection has been established for the camera; and

in accordance with a determination that a preliminary connection has not been established for the camera, establishing a preliminary connection for the camera.

6. The method of claim 5, wherein establishing the preliminary connection for the camera comprises:

prior to establishing the preliminary connection for the camera, determining whether a maximum number of preliminary connections has been reached; and

in accordance with a determination that the maximum number of preliminary connections has been reached;

based on a ranking of the preliminary connections, terminating a second preliminary connection; and

after terminating the second preliminary connection, establishing the preliminary connection for the camera.

7. The method of claim 4, further comprising:

receiving a request from the user to display a second view of the user interface;

determining that video feeds from a second subset of cameras of the plurality of cameras are to be displayed within the second view of the user interface, wherein the second subset of cameras does not include the particular camera;

reassigning the particular video player to a video feed from a camera in the second subset of cameras; and

displaying the second view of the user interface including displaying video feeds from each camera of the second subset of cameras.

8. The method of claim 7, wherein reassigning the particular video player to the video feed from the camera in the second subset of cameras comprises:

ceasing to display the video feed from the particular camera; and

displaying the video feed from the camera in the second subset of cameras.

9. The method of claim 7, wherein establishing the preliminary connection for each of at least a subset of the plurality of cameras comprises establishing a preliminary connection for the camera in the second subset of cameras;

and

the method further comprises;

after establishing the preliminary connection for the camera and before reassigning the particular video player, receiving the video feed from the camera; and

after reassigning the particular video player to the video feed from the camera in the second subset of cameras, transcoding the video feed from the camera.

10. The method of claim 1, wherein identifying the user interface comprises identifying the user interface based on one or more characteristics of the client device.

11. The method of claim 1, further comprising determining a video refresh rate for the video feed from the particular camera based on one or more connection parameters;

wherein displaying the user interface with the video feed comprises displaying the video feed at the determined video refresh rate.

12. The method of claim 1, further comprising, in response to the request for the video feed from the particular camera, receiving a portion of the video feed corresponding to a previously detected motion event;

wherein displaying the user interface with the video feed comprises displaying the portion of the video feed corresponding to the previously detected motion event.

13. An electronic device, comprising:

one or more processors;

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for;

receiving a request to execute an application for communicating with a plurality of smart devices, the plurality of smart devices including a plurality of cameras;

in response to receiving the request to execute the application, establishing a preliminary connection for each of at least a subset of the plurality of cameras;

identifying a user interface for display to a user via the display, the user interface including a video feed from a particular camera of the plurality of cameras;

after identifying the user interface for display, determining whether a preliminary connection has been established for the particular camera;

in accordance with a determination that the preliminary connection has been established for the particular camera, requesting, via the preliminary connection, the video feed for the particular camera; and

displaying the user interface with the video feed for the particular camera.

14. The electronic device of claim 13, wherein the one or more programs further comprise instructions for:

in accordance with a determination that the preliminary connection has not been established for the particular camera, establishing the preliminary connection for the particular camera; and

requesting, via the preliminary connection, the video feed for the particular camera.

15. The electronic device of claim 13, wherein the one or more programs further comprise instructions for:

predicting a display order for the plurality of cameras; and

ranking the plurality of cameras in accordance with the predicted display order;

wherein establishing the preliminary connection for each of at least the subset of the plurality of cameras comprises establishing the preliminary connection for each of at least the subset of the plurality of cameras based on the ranking.

16. The electronic device of claim 13, wherein the identified user interface includes a plurality of video players for simultaneous display to the user, and wherein the one or more programs further comprise instructions for:

determining that video feeds from a first subset of cameras of the plurality of cameras are to be displayed within the identified user interface, the first subset of cameras including the particular camera; and

assigning a video feed from each camera of the first subset of cameras to a video player of the plurality of video players, including assigning the video feed from the particular camera to a particular video player;

wherein displaying the user interface with the video feed comprises displaying a first view of the user interface including video feeds from each camera of the first subset of cameras.

17. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with one or more processors, cause the electronic device to perform operations comprising:

receiving a request to execute an application for communicating with a plurality of smart devices, the plurality of smart devices including a plurality of cameras;

in response to receiving the request to execute the application, establishing a preliminary connection for each of at least a subset of the plurality of cameras;

identifying a user interface for display to a user via the display, the user interface including a video feed from a particular camera of the plurality of cameras;

after identifying the user interface for display, determining whether a preliminary connection has been established for the particular camera;

in accordance with a determination that the preliminary connection has been established for the particular camera, requesting, via the preliminary connection, the video feed for the particular camera; and

displaying the user interface with the video feed for the particular camera.

18. The non-transitory computer-readable storage medium of claim 17, wherein the one or more programs further comprise instructions, which, when executed by the electronic device, cause the electronic device to perform operations comprising:

in accordance with a determination that the preliminary connection has not been established for the particular camera, establishing the preliminary connection for the particular camera; and

requesting, via the preliminary connection, the video feed for the particular camera.

19. The non-transitory computer-readable storage medium of claim 17, wherein the one or more programs further comprise instructions, which, when executed by the electronic device, cause the electronic device to perform operations comprising:

predicting a display order for the plurality of cameras; and

ranking the plurality of cameras in accordance with the predicted display order;

wherein establishing the preliminary connection for each of at least the subset of the plurality of cameras comprises establishing the preliminary connection for each of at least the subset of the plurality of cameras based on the ranking.

20. The non-transitory computer-readable storage medium of claim 17, wherein the identified user interface includes a plurality of video players for simultaneous display to the user, and wherein the one or more programs further comprise instructions, which, when executed by the electronic device, cause the electronic device to perform operations comprising:

determining that video feeds from a first subset of cameras of the plurality of cameras are to be displayed within the identified user interface, the first subset of cameras including the particular camera; and

assigning a video feed from each camera of the first subset of cameras to a video player of the plurality of video players, including assigning the video feed from the particular camera to a particular video player;

wherein displaying the user interface with the video feed comprises displaying a first view of the user interface including video feeds from each camera of the first subset of cameras.