Methods and devices for establishing connections with remote cameras

• US 10,263,802 B2
• Filed: 07/12/2016
• Issued: 04/16/2019
• Est. Priority Date: 07/12/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Burns, Christopher Charles, Clark, Gregory Cortis
• Primary Examiner(s): Camargo, Marly S
• Application Number:
  US15/208,585
• Publication Number:
  US 20180019889A1
• Time in Patent Office: 1,008 Days
• Field of Search: 725105, 709203, 709227, 709230, 710 1, 710 2, 710 3, 710 4, 710 5, 710 20, 710 53, 710 58, 715744, 345473, 3482113
• CPC Class Codes: H04L 12/2807 Exchanging configuration information on appliance services in a home automation network arrangements for maintenance or administration involving network analysis for automatically determining the actual topology of a network H04L41/12; hardware or software tools for network management using graphical user interfaces H04L41/22; address allocation H04L61/50
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 12/4625 Single bridge functionality, e.g. connection of two networks over a single bridge
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04L 2012/285 Generic home appliances, e.g. refrigerators

Abstract

The various embodiments described herein include methods, devices, and systems for presenting video feeds in a user interface. In one aspect, a method includes: (1) receiving a request to execute an application for communicating with a plurality of smart devices, including a plurality of cameras; (2) in response to receiving the request, establishing a connection for each of at least a subset of the cameras; (3) identifying a user interface for display to a user via the display, the user interface including a video feed from a particular camera; (4) after identifying the user interface, determining whether a connection has been established for the particular camera; (5) in accordance with a determination that the connection has been established for the particular camera, requesting, via the connection, the video feed for the particular camera; and (6) displaying the user interface with the video feed for the particular camera.

Claims

1. A method, comprising:

at a client device having a display, one or more processors, and memory storing one or more programs for execution by the one or more processors;

receiving a request from a user to execute an application for communicating with a plurality of smart devices, the plurality of smart devices including a plurality of cameras;

in response to receiving the user request to execute the application, establishing a preliminary connection via one or more wireless networks for each of at least a subset of the plurality of cameras, wherein establishing each preliminary network connection comprises completing a communication handshake between the client device and the camera;

identifying a user interface for display to the user via the display based on one or more characteristics of the client device, the user interface including a video feed from a particular camera of the plurality of cameras;

after identifying the user interface for display, determining whether a preliminary connection has been established for the particular camera;

in accordance with a determination that the preliminary connection has been established for the particular camera, requesting, via the preliminary connection, the video feed for the particular camera; and

displaying the user interface with the video feed for the particular camera via the display.

2. The method of claim 1, further comprising:

in accordance with a determination that the preliminary connection has not been established for the particular camera, establishing the preliminary connection for the particular camera; and

requesting, via the preliminary connection, the video feed for the particular camera.

3. The method of claim 1, further comprising:

predicting a display order for the plurality of cameras; and

ranking the plurality of cameras in accordance with the predicted display order;

wherein establishing the preliminary connection for each of at least the subset of the plurality of cameras comprises establishing the preliminary connection for each of at least the subset of the plurality of cameras based on the ranking.

4. The method of claim 1, wherein the identified user interface includes a plurality of video players for simultaneous display to the user, and the method further comprises:

determining that video feeds from a first subset of cameras of the plurality of cameras are to be displayed within the identified user interface, the first subset of cameras including the particular camera; and

assigning a video feed from each camera of the first subset of cameras to a video player of the plurality of video players, including assigning the video feed from the particular camera to a particular video player;

wherein displaying the user interface with the video feed comprises displaying a first view of the user interface including video feeds from each camera of the first subset of cameras.

5. The method of claim 4, further comprising, for each camera in the first subset of cameras:

determining whether a preliminary connection has been established for the camera; and

in accordance with a determination that a preliminary connection has not been established for the camera, establishing a preliminary connection for the camera.

6. The method of claim 5, wherein establishing the preliminary connection for the camera comprises:

prior to establishing the preliminary connection for the camera, determining whether a maximum number of preliminary connections has been reached; and

in accordance with a determination that the maximum number of preliminary connections has been reached;

based on a ranking of the preliminary connections, terminating a second preliminary connection; and

after terminating the second preliminary connection, establishing the preliminary connection for the camera.

7. The method of claim 4, further comprising:

receiving a request from the user to display a second view of the user interface;

determining that video feeds from a second subset of cameras of the plurality of cameras are to be displayed within the second view of the user interface, wherein the second subset of cameras does not include the particular camera;

reassigning the particular video player to a video feed from a camera in the second subset of cameras; and

displaying the second view of the user interface including displaying video feeds from each camera of the second subset of cameras.

8. The method of claim 7, wherein reassigning the particular video player to the video feed from the camera in the second subset of cameras comprises:

ceasing to display the video feed from the particular camera; and

displaying the video feed from the camera in the second subset of cameras.

9. The method of claim 7, wherein establishing the preliminary connection for each of at least a subset of the plurality of cameras comprises establishing a preliminary connection for the camera in the second subset of cameras;

and

the method further comprises;

after establishing the preliminary connection for the camera and before reassigning the particular video player, receiving the video feed from the camera; and

after reassigning the particular video player to the video feed from the camera in the second subset of cameras, transcoding the video feed from the camera.

10. The method of claim 1, further comprising determining a video refresh rate for the video feed from the particular camera based on one or more connection parameters;

wherein displaying the user interface with the video feed comprises displaying the video feed at the determined video refresh rate.

11. The method of claim 1, further comprising, in response to the request for the video feed from the particular camera, receiving a portion of the video feed corresponding to a previously detected motion event;

wherein displaying the user interface with the video feed comprises displaying the portion of the video feed corresponding to the previously detected motion event.

12. An electronic device, comprising:

a display;

one or more processors;

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for;

receiving a request from a user to execute an application for communicating with a plurality of smart devices, the plurality of smart devices including a plurality of cameras;

in response to receiving the user request to execute the application, establishing a preliminary connection via one or more wireless networks for each of at least a subset of the plurality of cameras, wherein establishing each preliminary network connection comprises completing a communication handshake between the electronic device and the camera;

identifying a user interface for display to the user via the display based on one or more characteristics of the electronic device, the user interface including a video feed from a particular camera of the plurality of cameras;

after identifying the user interface for display, determining whether a preliminary connection has been established for the particular camera;

in accordance with a determination that the preliminary connection has been established for the particular camera, requesting, via the preliminary connection, the video feed for the particular camera; and

displaying the user interface with the video feed for the particular camera via the display.

13. The electronic device of claim 12, wherein the one or more programs further comprise instructions for:

in accordance with a determination that the preliminary connection has not been established for the particular camera, establishing the preliminary connection for the particular camera; and

requesting, via the preliminary connection, the video feed for the particular camera.

14. The electronic device of claim 12, wherein the one or more programs further comprise instructions for:

predicting a display order for the plurality of cameras; and

ranking the plurality of cameras in accordance with the predicted display order;

wherein establishing the preliminary connection for each of at least the subset of the plurality of cameras comprises establishing the preliminary connection for each of at least the subset of the plurality of cameras based on the ranking.

15. The electronic device of claim 12, wherein the identified user interface includes a plurality of video players for simultaneous display to the user, and wherein the one or more programs further comprise instructions for:

determining that video feeds from a first subset of cameras of the plurality of cameras are to be displayed within the identified user interface, the first subset of cameras including the particular camera; and

assigning a video feed from each camera of the first subset of cameras to a video player of the plurality of video players, including assigning the video feed from the particular camera to a particular video player;

wherein displaying the user interface with the video feed comprises displaying a first view of the user interface including video feeds from each camera of the first subset of cameras.

16. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with a display and one or more processors, cause the electronic device to perform operations comprising:

receiving a request from a user to execute an application for communicating with a plurality of smart devices, the plurality of smart devices including a plurality of cameras;

in response to receiving the user request to execute the application, establishing a preliminary connection via one or more wireless networks for each of at least a subset of the plurality of cameras, wherein establishing each preliminary network connection comprises completing a communication handshake between the electronic device and the camera;

identifying a user interface for display to the user via the display based on one or more characteristics of the electronic device, the user interface including a video feed from a particular camera of the plurality of cameras;

after identifying the user interface for display, determining whether a preliminary connection has been established for the particular camera;

in accordance with a determination that the preliminary connection has been established for the particular camera, requesting, via the preliminary connection, the video feed for the particular camera; and

displaying the user interface with the video feed for the particular camera via the display.

17. The non-transitory computer-readable storage medium of claim 16, wherein the one or more programs further comprise instructions, which, when executed by the electronic device, cause the electronic device to perform operations comprising:

in accordance with a determination that the preliminary connection has not been established for the particular camera, establishing the preliminary connection for the particular camera; and

requesting, via the preliminary connection, the video feed for the particular camera.

18. The non-transitory computer-readable storage medium of claim 16, wherein the one or more programs further comprise instructions, which, when executed by the electronic device, cause the electronic device to perform operations comprising:

predicting a display order for the plurality of cameras; and

ranking the plurality of cameras in accordance with the predicted display order;

wherein establishing the preliminary connection for each of at least the subset of the plurality of cameras comprises establishing the preliminary connection for each of at least the subset of the plurality of cameras based on the ranking.

19. The non-transitory computer-readable storage medium of claim 16, wherein the identified user interface includes a plurality of video players for simultaneous display to the user, and wherein the one or more programs further comprise instructions, which, when executed by the electronic device, cause the electronic device to perform operations comprising:

determining that video feeds from a first subset of cameras of the plurality of cameras are to be displayed within the identified user interface, the first subset of cameras including the particular camera; and

assigning a video feed from each camera of the first subset of cameras to a video player of the plurality of video players, including assigning the video feed from the particular camera to a particular video player;

wherein displaying the user interface with the video feed comprises displaying a first view of the user interface including video feeds from each camera of the first subset of cameras.