Systems and methods for a supplemental display screen

• US 9,910,632 B1
• Filed: 07/10/2017
• Issued: 03/06/2018
• Est. Priority Date: 09/02/2016
• Status: Active Grant

• Current Assignee: Dryad LLC
• Original Assignee: Brent Foster Morgan
• Inventors: Morgan, Brent Foster
• Primary Examiner(s): Giesy, Adam R
• Application Number:
  US15/645,997
• Publication Number:
  US 20180067713A1
• Time in Patent Office: 239 Days
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G09G 2330/026 Arrangements or methods related to booting a display
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: G09G 2370/025 LAN communication management
• CPC Class Codes: G09G 2370/04 Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: H04W 84/042 Public Land Mobile systems, e.g. cellular systems
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]
• CPC Class Codes: H04W 88/08 Access point devices

Abstract

Systems and methods are disclosed for using a supplementary display device in conjunction with a first device, where the first device may have a smaller display than the supplementary display device. Icon images corresponding to applications installed on the first device are accessed and wirelessly transmitted to the supplementary display device. Touch data, corresponding to a user touch input on a touchscreen of the supplementary display device, is received at the first device. The touch data includes coordinate data corresponding to the user touch input on a touchscreen of the supplementary display device. Based at least in part on the touch data, a determination is to be made as whether an application on the first device is to be launched. The application is launched on the first device and a user interface corresponding to the launched application is transmitted to the supplementary display device.

Claims

1. A computer-implemented method comprising:

determining by a first device configuration data for the first device, wherein the first device hosts a communication and synchronization application;

wirelessly transmitting the determined first device configuration data from the first device to a supplementary display device;

determining, by the first device, a communication environment of the first device and generating corresponding communication environment data, the communication environment data indicating;

whether the first device is wirelessly connected to a WIFI access point, and

whether the first device has access to a cellular network;

based at least in part on a determination that the first device is wirelessly connected to a WIFI access point;

enabling the supplementary display device to connect directly to the WIFI access point by wirelessly transmitting data related to the WIFI access point to the supplementary display device;

based at least in part on a determination that the first device has access to the cellular network and is not wirelessly connected to a WIFI access point;

enabling the supplementary display device to access network resources using the first device'"'"'s access to the cellular network;

receiving from the supplementary display device by the first device touch data corresponding to a user touch input on a touchscreen of the supplementary display device, the touch data including at least coordinate data corresponding to the user touch input;

determining by the first device an action to be taken in response to the touch data received from the supplementary display device;

taking, by the first device, the determined action; and

wirelessly transmitting content associated with the taken action from the first device to the supplementary display device.

2. The method as defined in claim 1, the method further comprising:

receiving from the supplementary display device, via a first wireless interface, at the first device an unlock instruction; and

unlocking the first device at least partly in response to the wirelessly received unlock instruction.

3. The method as defined in claim 1, wherein transmitting content associated with the taken action from the first device to the supplementary display device further comprises:

transmitting video data from the first device to the supplementary display device using a WIFI connection; and

transmitting audio data, associated with the video data, from the first device to the supplementary display device using a Bluetooth connection.

4. The method as defined in claim 1, wherein the taken action comprises accessing, by the first device, video content over a network, the method further comprising streaming the accessed video content from the first device to the supplementary display device without changing a scaling or resolution of the accessed video content.

5. The method as defined in claim 1, wherein determining by the first device an action to be taken in response to the touch data further comprises determining if the coordinate data corresponds to an application, and wherein taking, by the first device, the determined action, further comprises launching the application.

6. The method as defined in claim 1, wherein determining, by the first device, an action to be taken in response to the touch data corresponding to the user touch input on the touchscreen of the supplementary display device further comprises determining if the user performed a swipe, expand, pinch, or rotate gesture on the touchscreen of the supplementary display device.

7. A computer-implemented method comprising:

determining by a first device configuration data for the first device, wherein the first device hosts a communication and synchronization application;

wirelessly transmitting the determined first device configuration data from the first device to a supplementary display device;

determining, by the first device, a communication environment of the first device and generating corresponding communication environment data, the communication environment data indicating whether the first device is wirelessly connected to a WIFI access point and whether the first device has access to a cellular network;

wirelessly transmitting the first device communication environment data from the first device to the supplementary display device, the communication environment data indicating whether the first device is wirelessly connected to a WIFI access point and whether the first device has access to a cellular network;

receiving from the supplementary display device by the first device touch data corresponding to a user touch input on a touchscreen of the supplementary display device, the touch data including at least coordinate data corresponding to the user touch input;

determining by the first device an action to be taken in response to the touch data received from the supplementary display device;

taking, by the first device, the determined action;

wirelessly transmitting content associated with the taken action from the first device to the supplementary display device;

determining by the first device, from second touch data received from the supplementary display device, that a request for a video embedded in a webpage is being requested;

attempting to identify, by the first device, a locator for the requested video;

at least partly in response to failing to identify the locator for the requested video, transmitting from the first device a request to a remote server system to identify the locator for the requested video;

receiving the locator for the requested video from the remote server system;

utilizing the received locator for the requested video to enable the supplementary display device to access the requested video.

8. A computer system, comprising:

a touchscreen display;

computing hardware;

a first wireless networking interface;

a second wireless networking interface;

a third wireless networking interface;

non-transitory memory that stores instructions that when executed by the computing hardware cause the computer system to perform operations comprising;

accessing configuration data of the computer system;

wirelessly transmitting the configuration data to a supplementary display device using the first wireless networking interface or the second wireless networking interface;

determining a communication environment of the computer system, comprising determining;

whether the computer system is wirelessly connected to a network access point using the second wireless networking interface, and

whether the computer system has access to a cellular network via the third wireless networking interface;

based at least in part on a determination that the computer system is wirelessly connected to the network access point;

enabling the supplementary display device to connect directly to the network access point by wirelessly transmitting data related to the network access point to the supplementary display device;

based at least in part on a determination that the first device has access to the cellular network and is not wirelessly connected to a network access point;

enabling the supplementary display device to access network resources using the computer system'"'"'s access to the cellular network;

receiving from the supplementary display device touch data corresponding to a user touch input on a touchscreen of the supplementary display device, the touch data including at least touch coordinate data;

determining at the computer system an action to be taken in response to the touch data, including at least the touch coordinate data received from the supplementary display device; and

taking, by the computer system, the determined action.

9. The system as defined in claim 8, the operations further comprising:

receiving from the supplementary display device, via the first wireless networking interface or the second wireless networking interface, an unlock instruction; and

performing an unlocking operation at least partly in response to the received unlock instruction.

10. The system as defined in claim 8, the operations further comprising:

transmitting video data to the supplementary display device using the second wireless networking interface; and

transmitting audio data, associated with the video data, to the supplementary display device using the first wireless networking interface.

11. The system as defined in claim 8, wherein the taken action comprises accessing video content over a network, the operations further comprising streaming the accessed video content to the supplementary display device without changing a scaling or resolution of the accessed video content.

12. The system as defined in claim 8, wherein determining an action to be taken in response to the touch data corresponding to the user touch input on the touchscreen of the supplementary display device further comprises determining if the coordinate data corresponds to an application, and wherein taking the determined action, further comprises launching the application.

13. The system as defined in claim 8, wherein determining an action to be taken in response to the touch data corresponding to the user touch input on the touchscreen of the supplementary display device further comprises determining if the user performed a swipe, expand, pinch, or rotate gesture on the touchscreen of the supplementary display device.

14. A computer system, comprising:

a touchscreen display;

computing hardware;

a first wireless networking interface;

a second wireless networking interface;

a third wireless networking interface;

non-transitory memory that stores instructions that when executed by the computing hardware cause the computer system to perform operations comprising;

accessing configuration data of the computer system;

wirelessly transmitting the configuration data to a supplementary display device using the first wireless networking interface or the second wireless networking interface;

determining a communication environment of the computer system and generating corresponding communication environment data, the communication environment data indicating whether the computer system is wirelessly connected to a network access point using the second wireless networking interface and indicating whether the computer system has access to a cellular network via the third wireless networking interface;

wirelessly transmitting the communication environment data to the supplementary display device;

receiving from the supplementary display device touch data corresponding to a user touch input on a touchscreen of the supplementary display device, the touch data including at least touch coordinate data;

determining at the computer system an action to be taken in response to the touch data, including at least the touch coordinate data received from the supplementary display device;

taking, by the computer system, the determined action;

determining, from second touch data received from the supplementary display device, that a request for a video embedded in a webpage is being requested;

attempting to identify a locator in the webpage for the requested video;

at least partly in response to failing to identify the locator for the requested video, transmitting a request to a remote system to identify the locator for the requested video;

receiving the locator for the requested video from the remote system; and

utilizing the received locator for the requested video to enable the supplementary display device to access the requested video.

15. A non-transitory memory that stores instructions that when executed by a computing system cause the computer system to perform operations comprising:

accessing configuration data of the computer system;

wirelessly transmitting the configuration data to a supplementary display device using a first wireless networking interface or a second wireless networking interface;

determining a communication environment of the computer system, comprising determining;

whether the computer system is wirelessly connected to a network access point using the second wireless networking interface, and

whether the computer system has access to a cellular network via a third wireless networking interface;

based at least in part on a determination that the computer system is wirelessly connected to the network access point;

enabling the supplementary display device to connect directly to the network access point by wirelessly transmitting data related to the network access point to the supplementary display device;

based at least in part on a determination that the computer system has access to the cellular network and is not wirelessly connected to a network access point;

enabling the supplementary display device to access network resources using the computer system'"'"'s access to the cellular network;

receiving from the supplementary display device touch data corresponding to a user touch input on a touchscreen of the supplementary display device, the touch data including at least touch coordinate data;

determining an action to be taken in response to the touch data, including at least the touch coordinate data, received from the supplementary display device; and

taking the determined action.

16. The non-transitory memory as defined in claim 15, the operations further comprising:

transmitting an item of content to a first plurality of supplementary display devices and causing the item of content to be presented on the first plurality of supplementary display devices at the same time.

17. The non-transitory memory as defined in claim 15, the operations further comprising:

transmitting video data to the supplementary display device using the second wireless networking interface; and

transmitting audio data, associated with the video data, to the supplementary display device using the first wireless networking interface.

18. The non-transitory memory as defined in claim 15, wherein determining an action to be taken in response to the touch data corresponding to the user touch input on the touchscreen of the supplementary display device further comprises determining if the coordinate data corresponds to an application, and wherein taking the determined action further comprises launching the application.

19. The non-transitory memory as defined in claim 15, wherein determining an action to be taken in response to the touch data corresponding to the user touch input on the touchscreen of the supplementary display device further comprises determining if the user performed a swipe, expand, pinch, or rotate gesture on the touchscreen of the supplementary display device.

20. A non-transitory memory that stores instructions that when executed by a computing system cause the computer system to perform operations comprising:

accessing configuration data of the computer system;

wirelessly transmitting the configuration data to a supplementary display device using a first wireless networking interface or a second wireless networking interface;

determining a communication environment of the computer system and generating corresponding communication environment data, the communication environment data indicating whether the computer system is wirelessly connected to a network access point using the second wireless networking interface and indicating whether the computer system has access to a cellular network via a third wireless networking interface;

wirelessly transmitting the communication environment data to the supplementary display device;

receiving from the supplementary display device touch data corresponding to a user touch input on a touchscreen of the supplementary display device, the touch data including at least touch coordinate data;

determining an action to be taken in response to the touch data, including at least the touch coordinate data, received from the supplementary display device;

taking the determined action;

determining, from touch data received from the supplementary display device, that a request for a video embedded in a webpage is being requested;

attempting to identify a locator in the webpage for the requested video;

at least partly in response to failing to identify the locator for the requested video, transmitting a request to a remote system to identify the locator for the requested video;

receiving the locator for the requested video from the remote system; and

utilizing the received locator for the requested video to enable the supplementary display device to access the requested video.

21. A non-transitory memory that stores instructions that when executed by a computing system cause the computer system to perform operations comprising:

determining;

whether the computer system is wirelessly connected to a network access point using a first wireless networking interface, and whether the computer system has access to a cellular network via a second wireless networking interface;

based at least in part on a determination that the computer system is wirelessly connected to the network access point;

enabling a supplementary display device to connect directly to the network access point by wirelessly transmitting data related to the network access point to the supplementary display device;

based at least in part on a determination that the computer system has access to the cellular network and is not wirelessly connected to a network access point;

enabling the supplementary resources using the computer system'"'"'s access to the cellular network;

identifying one or more applications installed on the computing system;

accessing icon images corresponding to the one or more applications installed on the computing system;

wirelessly transmitting the icon images corresponding to the one or more applications installed on the computing system to a supplementary display device;

receiving from the supplementary display device touch data corresponding to a user touch input on a touchscreen of the supplementary display device, the touch data including at least touch coordinate data;

determining based at least in part on the touch data, including at least the coordinate data, whether an application on the computer system is to be launched;

in response to determining that an application on the computer system is to be launched, launching the application; and

transmitting a user interface corresponding to the launched application to the supplementary display device.

22. The non-transitory memory as defined in claim 21, the operations further comprising:

transmitting an item of content to a first plurality of supplementary display devices and causing the item of content to be presented on the first plurality of supplementary display devices at the same time.

23. The non-transitory memory as defined in claim 21, the operations further comprising:

transmitting video data and associated audio data to the supplementary display device, wherein the audio data is transmitted to the supplementary display device using a different network interface than that used to transmit the video data to the supplementary display device.

24. The non-transitory memory as defined in claim 21, the operations further comprising:

wirelessly accessing video content from a remote source in response to the touch data from the supplementary display device; and

streaming the accessed video content to the supplementary display device without changing a scaling or resolution of the accessed video content.

25. The non-transitory memory as defined in claim 21, the operations further comprising:

determining;

from second touch data received from the supplementary display device, if the user performed a swipe, expand, pinch, or rotate gesture on the touchscreen of the supplementary display device, and taking a corresponding action.

26. A non-transitory memory that stores instructions that when executed by a computing system cause the computer system to perform operations comprising:

identifying one or more applications installed on the computing system;

accessing icon images corresponding to the one or more applications installed on the computing system;

wirelessly transmitting the icon images corresponding to the one or more applications installed on the computing system to a supplementary display device;

receiving from the supplementary display device touch data corresponding to a user touch input on a touchscreen of the supplementary display device, the touch data including at least touch coordinate data;

determining based at least in part on the touch data, including at least the coordinate data, whether an application on the computer system is to be launched;

in response to determining that an application on the computer system is to be launched, launching the application;

transmitting a user interface corresponding to the launched application to the supplementary display device;

determining, from touch data received from the supplementary display device, that a request for a video embedded in a webpage is being requested;

attempting to identify a locator in the webpage for the requested video;

at least partly in response to failing to identify the locator for the requested video, transmitting a request to a remote system to identify the locator for the requested video;

receiving the locator for the requested video from the remote system; and

utilizing the received locator for the requested video to enable the supplementary display device to access the requested video.