Switching display modes based on connection state

• US 9,715,364 B2
• Filed: 09/21/2015
• Issued: 07/25/2017
• Est. Priority Date: 08/27/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Lee, Reena Singhal
• Primary Examiner(s): HARRIS, DOROTHY H
• Application Number:
  US14/859,543
• Publication Number:
  US 20160011841A1
• Time in Patent Office: 673 Days
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2380/14 Electronic books and readers
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for switching display modes based on connections between devices. In one aspect, it is determined that an external display has been connected to or disconnected from a mobile device. Based on the determining, an application executing on the mobile device is switched between a first display mode and a second display mode. In the first display mode, a single user interface is displayed on the touch screen of the mobile device. In the second display mode, a first user interface is displayed on the external display and a second user interface, for receiving user inputs, is displayed on the touch screen of the mobile device.

Claims

1. A computer-implemented method comprising:

providing, by the mobile device and for display on a touch screen of a mobile device, a first mobile user interface that includes a visual element and a first set of controls that are configured to control the visual element;

after providing the first mobile user interface, determining, by the mobile device, that the mobile device has established a local connection with an external display;

in response to determining, by the mobile device, that the mobile device has established a local connection with the external display, generating, by the mobile device, a second mobile interface that includes a selectable option to provide, by the mobile device, display data to the external display;

providing, by the mobile device and for display on the touch screen of the mobile device, the second mobile interface that includes the selectable option to provide display data to the external display;

receiving, by the mobile device, data indicating a user selection of the selectable option to provide, by the mobile device, display data to the external display;

in response to receiving, by the mobile device, the data indicating the user selection of the selectable option to provide display data to the external display, generating, by the mobile device, an external user interface that only includes the visual element;

in response to receiving, by the mobile device, the data indicating the user selection of the selectable option to provide display data to the external display, generating, by the mobile device, a third mobile user interface that;

includes (i) the first set of controls that are configured to control the visual element that is included in the external user interface and (ii) a second set of controls that are not included in the first mobile user interface and that are configured to control the visual element that is included in the external user interface differently than the first set of controls, and excludes the visual element that is included in the external user interface;

providing, by the mobile device and for display on the touch screen of the mobile device, the third mobile user interface;

providing, by the mobile device, over the local connection, and for display on the external display, the external user interface;

while providing by the mobile device, over the local connection, and for display on the external display, the external user interface, determining, by the mobile device, that a user has interacted with the third mobile user interface in a particular manner;

in response to determining that the user has interacted with the third mobile user interface in the particular manner, generating, by the mobile device, a fourth mobile user interface that;

includes a third, different set of controls (i) that are configured to control the visual element that is included in the external user interface differently than the first set of controls and the second set of controls and (ii) that include controls to switch the visual element that is included in the external interface between a satellite mode, a street view mode, and a map mode, and excludes the visual element that is included in the external user interface; and

providing, by the mobile device, over the local connection, and for display on the touch screen of the mobile device, the fourth mobile user interface.

2. The method of claim 1, comprising:

determining that the external display has been disconnected from the mobile device;

in response to determining that the external display has been disconnected from the mobile device, providing, by the mobile device and for display on the touch screen of the mobile device, the first mobile user interface and stopping to provide, by the mobile device and for display on the external display, the external user interface.

3. The method of claim 2, comprising:

determining, by the mobile device, that the mobile device has established an additional local connection with the external display;

in response to determining, by the mobile device, that the mobile device has established the additional local connection with the external display, generating, by the mobile device, an additional second mobile interface that includes the selectable option to provide, by the mobile device, display data to the external display;

providing, by the mobile device and for display on the touch screen of the mobile device, the additional second mobile interface that includes the selectable option to provide, by the mobile device, display data to the external display;

receiving, by the mobile device, data indicating a user dismissal of the additional second mobile interface without selecting the selectable option to provide, by the mobile device, display data to the external display; and

while the mobile device and the external display remain connected through the local connection, continuing to provide, by the mobile device and for display on the touch screen of the mobile device, the first mobile user interface without providing a user interface to the external display.

4. The method of claim 1, wherein:

the visual element that is included in the external user interface comprises a map,

the first set of controls that are configured to control the map included in the external user interface comprises a panning control and a keyboard,

the second set of controls that are configured to control the map included in the external user interface comprises scroll bars, the keyboard, and a text box, and

the third set of control that are configured to control the map included in the external user interface comprises a zoom control, the panning control, and voice controls.

5. The method of claim 1, wherein the local connection is a direct wired data connection or a direct short range radio data connection.

6. The method of claim 1, wherein:

the first set of controls included in the first mobile user interface are a first size, and

the second set of controls included in the second mobile user interface are a second size that is larger than the first size.

7. The method of claim 1, wherein the second mobile interface further includes a selectable option to not provide, by the mobile device, display data to the external display.

8. The method of claim 1, wherein determining, by the mobile device, that a user has interacted with the third mobile user interface in a particular manner comprises:

determining that the user has entered a geographic address into the third mobile user interface.

9. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

providing, by the mobile device and for display on a touch screen of a mobile device, a first mobile user interface that includes a visual element and a first set of controls that are configured to control the visual element;

after providing the first mobile user interface, determining, by the mobile device, that the mobile device has established a local connection with an external display;

in response to determining, by the mobile device, that the mobile device has established a local connection with the external display, generating, by the mobile device, a second mobile interface that includes a selectable option to provide, by the mobile device, display data to the external display;

providing, by the mobile device and for display on the touch screen of the mobile device, the second mobile interface that includes the selectable option to provide display data to the external display;

receiving, by the mobile device, data indicating a user selection of the selectable option to provide, by the mobile device, display data to the external display;

in response to receiving, by the mobile device, the data indicating the user selection of the selectable option to provide display data to the external display, generating, by the mobile device, an external user interface that only includes the visual element;

in response to receiving, by the mobile device, the data indicating the user selection of the selectable option to provide display data to the external display, generating, by the mobile device, a third mobile user interface that;

includes (i) the first set of controls that are configured to control the visual element that is included in the external user interface and (ii) a second set of controls that are not included in the first mobile user interface and that are configured to control the visual element that is included in the external user interface differently than the first set of controls, and excludes the visual element that is included in the external user interface;

providing, by the mobile device and for display on the touch screen of the mobile device, the third mobile user interface;

providing, by the mobile device, over the local connection, and for display on the external display, the external user interface;

while providing by the mobile device, over the local connection, and for display on the external display, the external user interface, determining, by the mobile device, that a user has interacted with the third mobile user interface in a particular manner;

in response to determining that the user has interacted with the third mobile user interface in the particular manner, generating, by the mobile device, a fourth mobile user interface that;

includes a third, different set of controls (i) that are configured to control the visual element that is included in the external user interface differently than the first set of controls and the second set of controls and (ii) that include controls to switch the visual element that is included in the external interface between a satellite mode, a street view mode, and a map mode, and excludes the visual element that is included in the external user interface; and

providing, by the mobile device, over the local connection, and for display on the touch screen of the mobile device, the fourth mobile user interface.

10. The system of claim 9, wherein the operations further comprise:

determining that the external display has been disconnected from the mobile device;

in response to determining that the external display has been disconnected from the mobile device, providing, by the mobile device and for display on the touch screen of the mobile device, the first mobile user interface and stopping to provide, by the mobile device and for display on the external display, the external user interface.

11. The system of claim 9, wherein:

the visual element that is included in the external user interface comprises a map,

the first set of controls that are configured to control the map included in the external user interface comprises a panning control and a keyboard,

the second set of controls that are configured to control the map included in the external user interface comprises scroll bars, the keyboard, and a text box, and

the third set of control that are configured to control the map included in the external user interface comprises a zoom control, the panning control, and voice controls.

12. The system of claim 10, wherein the operations further comprise:

determining, by the mobile device, that the mobile device has established an additional local connection with the external display;

in response to determining, by the mobile device, that the mobile device has established the additional local connection with the external display, generating, by the mobile device, an additional second mobile interface that includes the selectable option to provide, by the mobile device, display data to the external display;

providing, by the mobile device and for display on the touch screen of the mobile device, the additional second mobile interface that includes the selectable option to provide, by the mobile device, display data to the external display;

receiving, by the mobile device, data indicating a user dismissal of the additional second mobile interface without selecting the selectable option to provide, by the mobile device, display data to the external display; and

while the mobile device and the external display remain connected through the local connection, continuing to provide, by the mobile device and for display on the touch screen of the mobile device, the first mobile user interface without providing a user interface to the external display.

13. The system of claim 9, wherein the local connection is a direct wired data connection or a direct short range radio data connection.

14. The system of claim 9, wherein:

the first set of controls included in the first mobile user interface are a first size, and

the second set of controls included in the second mobile user interface are a second size that is larger than the first size.

15. The system of claim 9, wherein the second mobile interface further includes a selectable option to not provide, by the mobile device, display data to the external display.

16. The system of claim 9, wherein determining, by the mobile device, that a user has interacted with the third mobile user interface in a particular manner comprises:

determining that the user has entered a geographic address into the third mobile user interface.

17. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

providing, by the mobile device and for display on a touch screen of a mobile device, a first mobile user interface that includes a visual element and a first set of controls that are configured to control the visual element;

after providing the first mobile user interface, determining, by the mobile device, that the mobile device has established a local connection with an external display;

in response to determining, by the mobile device, that the mobile device has established a local connection with the external display, generating, by the mobile device, a second mobile interface that includes a selectable option to provide, by the mobile device, display data to the external display;

providing, by the mobile device and for display on the touch screen of the mobile device, the second mobile interface that includes the selectable option to provide display data to the external display;

receiving, by the mobile device, data indicating a user selection of the selectable option to provide, by the mobile device, display data to the external display;

in response to receiving, by the mobile device, the data indicating the user selection of the selectable option to provide display data to the external display, generating, by the mobile device, an external user interface that only includes the visual element;

in response to receiving, by the mobile device, the data indicating the user selection of the selectable option to provide display data to the external display, generating, by the mobile device, a third mobile user interface that;

includes (i) the first set of controls that are configured to control the visual element that is included in the external user interface and (ii) a second set of controls that are not included in the first mobile user interface and that are configured to control the visual element that is included in the external user interface differently than the first set of controls, and excludes the visual element that is included in the external user interface;

providing, by the mobile device and for display on the touch screen of the mobile device, the third mobile user interface;

providing, by the mobile device, over the local connection, and for display on the external display, the external user interface;

while providing by the mobile device, over the local connection, and for display on the external display, the external user interface, determining, by the mobile device, that a user has interacted with the third mobile user interface in a particular manner;

in response to determining that the user has interacted with the third mobile user interface in the particular manner, generating, by the mobile device, a fourth mobile user interface that;

includes a third, different set of controls (i) that are configured to control the visual element that is included in the external user interface differently than the first set of controls and the second set of controls and (ii) that include controls to switch the visual element that is included in the external interface between a satellite mode, a street view mode, and a map mode, and excludes the visual element that is included in the external user interface; and

providing, by the mobile device, over the local connection, and for display on the touch screen of the mobile device, the fourth mobile user interface.

18. The medium of claim 17, wherein the operations further comprise:

determining that the external display has been disconnected from the mobile device;

in response to determining that the external display has been disconnected from the mobile device, providing, by the mobile device and for display on the touch screen of the mobile device, the first mobile user interface and stopping to provide, by the mobile device and for display on the external display, the external user interface.

19. The medium of claim 17, wherein:

the visual element that is included in the external user interface comprises a map,

the first set of controls that are configured to control the map included in the external user interface comprises a panning control and a keyboard,

the second set of controls that are configured to control the map included in the external user interface comprises scroll bars, the keyboard, and a text box, and

the third set of control that are configured to control the map included in the external user interface comprises a zoom control, the panning control, and voice controls.

20. The medium of claim 17, wherein the local connection is a direct wired data connection or a direct short range radio data connection.

21. The medium of claim 17, wherein:

the first set of controls included in the first mobile user interface are a first size, and

the second set of controls included in the second mobile user interface are a second size that is larger than the first size.

22. The medium of claim 17, wherein the second mobile interface further includes a selectable option to not provide, by the mobile device, display data to the external display.

23. The medium of claim 17, wherein determining, by the mobile device, that a user has interacted with the third mobile user interface in a particular manner comprises:

determining that the user has entered a geographic address into the third mobile user interface.