Auxiliary display system architecture

• US 7,660,914 B2
• Filed: 05/03/2004
• Issued: 02/09/2010
• Est. Priority Date: 05/03/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Rhoten, Matthew P., Perez, Juan, Fuller, Andrew J., Chandley, Adrian, Steeb, Curt A., Schoppa, Christopher A.
• Primary Examiner(s): Sorrell; Eron J
• Application Number:
  US10/838,174
• Publication Number:
  US 20050243021A1
• Time in Patent Office: 2,108 Days
• Field of Search: 710 15- 16
• US Class Current: 710/15
• CPC Class Codes: G06F 1/1613 for portable computers cooling arrangements therefor G06F1/203; constructional details or arrangements for pocket calculators, electronic agendas or books G06F15/0216; constructional details of portable telephone sets: with several bodies H04M1/0202
• CPC Class Codes: G06F 1/1632 External expansion units, e.g. docking stations
• CPC Class Codes: G06F 1/165 the additional display being small, e.g. for presenting status information
• CPC Class Codes: G06F 3/1438 using more than one graphics controller
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G09G 5/001 Arbitration of resources in a display system, e.g. control of access to frame buffer by video controller and/or main processor

Abstract

Described is an architecture by which application programs can provide data to auxiliary display devices of essentially any type for display to a user. A defined application layer (e.g., accessed via interfaces) allows programs to provide data to a service that controls the output of data to an auxiliary display device, and returns navigational data to the application upon appropriate user interaction with the device via actuators. Enumeration allows applications to discover the capabilities of a device, while arbitration determines which application has input-output rights to the device. The architecture further provides a protocol layer including pluggable protocol proxies that allow various types of displays to serve as an auxiliary display. This platform-like model allows program developers the ability provide programs that leverage auxiliary displays when available, and provides display manufacturers the ability to provide displays with extensible capabilities.

Claims

1. A computer system that includes one or more auxiliary display devices and at least one computer program, a system for providing an auxiliary display service that facilitates communication between the at least one computer program and the one or more auxiliary display devices, such that any display device capable of communication with the at least one computer program via the auxiliary display service is capable of displaying information from the at least one computer program, the system comprising:

a regular display coupled to the computer system configured to display information from a plurality of computer programs;

a first auxiliary display device coupled to the computer system to present auxiliary information, the first auxiliary display device comprising any device with a display that is configurable to interface with the computer system, wherein the first auxiliary display is independent of the regular display and includes both a plurality of user interface controls that are not included in a second auxiliary display device and a plurality of display device features that are not included in the second auxiliary display device;

the second auxiliary display device coupled to the computer system to present auxiliary information, the second auxiliary display device comprising any device with a display that is configurable to interface with the computer system, wherein the second auxiliary display is independent of the regular display and includes both a plurality of user interface controls that are not included in the first auxiliary display device and a plurality of display device features that are not included in the first auxiliary display device, wherein the first and the second auxiliary display devices are remote from the computer system;

an auxiliary display service that runs on the computer system and is accessed through an interface by a plurality of computer programs that are running on the computer system, the auxiliary display service configured to abstract display data such that the display data from a single program can be output to many different auxiliary display devices having different display characteristics, the auxiliary display service performing the following;

receive information from the first auxiliary display device describing one or more display constraints that limit the amount of information displayable by the first auxiliary display device, the information including an indication of one or more display features and one or more user interface controls of the first auxiliary display device, the user interface controls indication including a number and type of inputs available on the first auxiliary display device;

receive information from the second auxiliary display device describing one or more display constraints that limit the amount of information displayable by the second auxiliary display device, the information including an indication of one or more display features and one or more user interface controls of the second auxiliary display device, the user interface controls indication including a number and type of inputs available on the second auxiliary display device;

receive from at least one of the plurality of computer programs a function call configured to display information on each of the first and second auxiliary display devices coupled to the computer system, the at least one of the plurality of computer programs being configured to send a variable, selectable amount of information to each of the auxiliary display devices, depending on the indicated display features and the indicated user interface controls of each auxiliary display device, such that the auxiliary display service is configured to output different portions of display information from the same computer program to each of the first and second auxiliary display devices, wherein the portions of display information are based on each device'"'"'s indicated display features and indicated user interface controls;

based on the received display features and user interface control information from the first auxiliary display device, tailor the information that is to be displayed on the first auxiliary display device as a result of the function call based on the first auxiliary device'"'"'s indicated display features and indicated user interface controls, such that each portion of the information that is displayable according to the available display features is displayed in a manner corresponding to the first auxiliary display device'"'"'s display features and is navigable using each of the first auxiliary display device'"'"'s user interface controls; and

based on the received display features and user interface control information from the second auxiliary display device, tailor the information that is to be displayed on the second auxiliary display device as a result of the function call based on the second auxiliary device'"'"'s indicated display features and indicated user interface controls, such that each portion of the information that is displayable according to the available display features is displayed in a manner corresponding to the second auxiliary display device'"'"'s display features and is navigable using each of the second auxiliary display device'"'"'s user interface controls;

an offline interaction manager configured to perform the following upon detecting that the computer system is turned off or is in a standby/hibernate state;

store the tailored information for the first auxiliary display device in a system cache;

store the tailored information for the second auxiliary display device in the system cache;

upon receiving navigation inputs at the first auxiliary display device via the first auxiliary display device'"'"'s user interface controls, determine which portion of the tailored information stored for the first auxiliary display device is to be displayed on the first auxiliary display device based on which navigation inputs were received;

upon receiving navigation inputs at the second auxiliary display device via the second auxiliary display device'"'"'s user interface controls, determine which portion of the tailored information stored for the second auxiliary display device is to be displayed on the second auxiliary display device based on which navigation inputs were received;

send the determined portion of stored tailored information for the first auxiliary display device to the first auxiliary display device; and

send the determined portion of stored tailored information for the second auxiliary display device to the second auxiliary display device; and

a mediation component of the auxiliary display device service that determines which of the at least one of the plurality of computer programs can have tailored information presented and on which of the auxiliary display devices the tailored information can be presented.

2. The system of claim 1 wherein the mediation component communicates information corresponding to an output capability of the auxiliary display devices to the at least one of the plurality of computer programs.

3. The system of claim 1 further comprising a protocol component set containing at least one selectable protocol component, and wherein the auxiliary display service communicates with the auxiliary display device via a selected protocol component selected from the protocol component set that corresponds to a protocol used by the auxiliary display device.

4. The system of claim 3 wherein each said protocol component of the protocol component set plugs into the interface of the auxiliary display service.

5. The system of claim 1, wherein the tailored information received from the auxiliary display service comprises rendering instructions.

6. The system of claim 1 wherein the at least one of a plurality of computer programs each includes a mechanism for receiving events related to the auxiliary display device.

7. The system of claim 6 wherein an event received by a computer program corresponds to a request to provide data for presentation.

8. The system of claim 6 wherein the auxiliary display devices have associated actuators, and wherein an event received by a computer program corresponds to a navigation command.

9. The system of claim 6 wherein the auxiliary display devices have associated actuators, and wherein the mediation component determines which of the at least one of the plurality of computer programs receives events corresponding to actuation of an actuator.

10. The system of claim 1 wherein at least one of the auxiliary display devices is coupled to the computer system via a wireless connection.

11. The system of claim 1, wherein the auxiliary display device includes at least one navigational button that is not included in the regular display.

12. The system of claim 11, wherein tailoring the information that is to be displayed on the auxiliary display device as a result of the function call comprises adjusting the information to indicate that the auxiliary display device accepts navigation commands from the navigational button that is not included in the regular display.

13. The system of claim 1, wherein the cached information is cached in the auxiliary display device'"'"'s memory.

14. The system of claim 1, wherein the first and the second auxiliary display devices communicate with the computer system using different protocols.

15. The system of claim 1, wherein the first and the second auxiliary display devices implement different interfaces in communicating with the computer system.

16. The system of claim 1, wherein the information is tailored and sent to both the first and the second auxiliary displays simultaneously, the first and the second displays being simultaneously operable.

17. The system of claim 1, further comprising a button configured to switch between a plurality of notifications email notifications, voicemail notifications, calendar notifications, system status notifications and caller ID lists.

18. A computer system that includes a plurality of auxiliary display devices, at least one computer program, and at least one regular display configured to display information from the at least one computer program, a method for providing an auxiliary display service that facilitates communication between the at least one computer program and the auxiliary display devices, such that any display device capable of communication with the at least one computer program via the auxiliary display service is capable of displaying information from the at least one computer program, the method comprising:

receiving, at the auxiliary display service, a function call from at least one of a plurality of computer programs, the function call being configured to display information at a plurality of auxiliary display devices coupled to the computer system, the at least one of the plurality of computer programs being configured to send a variable, selectable amount of information to each of the auxiliary display devices, depending on indicated display features and indicated user interface controls of each auxiliary display device, wherein a first auxiliary display device comprises any device with a display that is configurable to interface with the computer system, the first auxiliary display being independent of the regular display and including both a plurality of user interface controls that are not included in a second auxiliary display device and a plurality of display features that are not included in the second auxiliary display device;

receiving information from the first auxiliary display device describing one or more display constraints that limit the amount of information displayable by the first auxiliary display device, the information including an indication of one or more display features and one or more user interface controls of the first auxiliary display device, the user interface controls indication including a number and type of inputs available on the first auxiliary display device;

receiving information from the second auxiliary display device describing one or more display constraints that limit the amount of information displayable by the second auxiliary display device, the information including an indication of one or more display features and one or more user interface controls of the second auxiliary display device, the user interface controls indication including a number and type of inputs available on the second auxiliary display device;

receiving from at least one of a plurality of computer programs a function call configured to display information on each of the first and second auxiliary display devices coupled to the computer system, the at least one of a plurality of computer programs being configured to send a variable, selectable amount of information to each of the auxiliary display devices, depending on the indicated display features and the indicated user interface controls of each auxiliary display device, such that the auxiliary display service is configured to output different portions of display information from the same computer program to each of the first and second auxiliary display devices, wherein the portions of display information are based on each device'"'"'s indicated display features and indicated user interface controls;

based on the received display features and user interface control information from the first auxiliary display device, tailoring the information that is to be displayed on the first auxiliary display device as a result of the function call based on the first auxiliary device'"'"'s indicated display features and indicated user interface controls, such that each portion of the information that is displayable according to the available display features is displayed in a manner corresponding to the first auxiliary display device'"'"'s display features and is navigable using each of the first auxiliary display device'"'"'s user interface controls;

based on the received display features and user interface control information from the second auxiliary display device, tailoring the information that is to be displayed on the second auxiliary display device as a result of the function call based on the second auxiliary device'"'"'s indicated display features and indicated user interface controls, such that each portion of the information that is displayable according to the available display features is displayed in a manner corresponding to the second auxiliary display device'"'"'s display features and is navigable using each of the second auxiliary display device'"'"'s user interface controls; and

performing the following upon detecting that the computer system is turned off or is in a standby/hibernate state;

storing the tailored information for the first auxiliary display device in a system cache;

storing the tailored information for the second auxiliary display device in the system cache;

upon receiving navigation inputs at the first auxiliary display device via the first auxiliary display device'"'"'s user interface controls, determining which portion of the tailored information stored for the first auxiliary display device is to be displayed on the first auxiliary display device based on which navigation inputs were received;

upon receiving navigation inputs at the second auxiliary display device via the second auxiliary display device'"'"'s user interface controls, determining which portion of the tailored information stored for the second auxiliary display device is to be displayed on the second auxiliary display device based on which navigation inputs were received;

sending the determined portion of stored tailored information for the first auxiliary display device to the first auxiliary display device; and

sending the determined portion of stored tailored information for the second auxiliary display device to the second auxiliary display device.

19. The method of claim 18 wherein receiving the function call includes receiving a request to register a computer program for coupling to at least one of the auxiliary display devices.

20. The method of claim 18 wherein receiving the function call includes receiving a request to enumerate capabilities of at least one of the auxiliary display devices.

21. The method of claim 18 further comprising receiving an event and determining information to present on the auxiliary display device based on the event.

22. The method of claim 18 further comprising receiving the requested data and communicating the data to at least one of the auxiliary display devices for presentation.

23. The method of claim 18 further comprising, receiving data from a computer program for presentation on the auxiliary display device, and communicating the data to at least one of the auxiliary display devices for presentation via a pluggable protocol component corresponding to a communications protocol used by at least one of the auxiliary display devices.

24. A computer-readable storage medium having computer-executable instructions, which when executed perform the method of claim 18.

25. The method of claim 18, further comprising receiving a navigation command from the auxiliary display device.

26. The method of claim 25 wherein the navigation command corresponds to a selection of a computer program, and wherein determining information to present on at least one of the auxiliary display devices comprises determining which computer program was selected and sending data to the selected computer program to request that the selected computer program provide data for presenting information on at least one of the auxiliary display devices.

27. The method of claim 25 wherein the navigation command corresponds to navigation within data of a selected computer program, and wherein determining information to present on at least one of the auxiliary display devices comprises sending the navigation command to the selected computer program.

28. The method of claim 18, wherein the determination that the information to be displayed as a result of the received function call has a higher display priority than the information currently being displayed on the auxiliary display device is based on the occurrence of an event.

29. The method of claim 28, further comprising displaying another application'"'"'s data on the auxiliary display device, the data including information associated with the event.

30. The method of claim 28, further comprising displaying a shell application home page including the information associated with the event.

31. The method of claim 28, further comprising overwriting a portion of the currently displayed content with the information associated with the event.

32. A computer system comprising:

one or more processors;

a memory;

a regular display coupled to the computer system configured to display information from a plurality of computer programs;

a first auxiliary display device coupled to the computer system to present auxiliary information, the first auxiliary display device comprising any device with a display that is configurable to interface with the computer system, wherein the first auxiliary display is independent of the regular display and includes both a plurality of user interface controls that are not included in a second auxiliary display device and a plurality of display features that are not included in the second auxiliary display device;

the second auxiliary display device coupled to the computer system to present auxiliary information, the second auxiliary display device comprising any device with a display that is configurable to interface with the computer system, wherein the second auxiliary display is independent of the regular display and includes both a plurality of user interface controls that are not included in the first auxiliary display device and a plurality of display features that are not included in the first auxiliary display device, wherein the first and the second auxiliary displays are remote from the computer system;

a protocol component set containing at least one selectable protocol component;

an auxiliary display device service that runs on the computer system and communicates with the auxiliary display device via a selected protocol component from the protocol component set that corresponds to the protocol for the auxiliary display device, the auxiliary display device being configured to abstract display data such that the display data from a single program can be output to many different auxiliary display devices having different display characteristics, the auxiliary display service performing the following;

receive information from the first auxiliary display device describing one or more display constraints that limit the amount of information displayable by the first auxiliary display device, the information including an indication of one or more display features and one or more user interface controls of the first auxiliary display device, the user interface controls indication including a number and type of inputs available on the first auxiliary display device;

receive information from the second auxiliary display device describing one or more display constraints that limit the amount of information displayable by the second auxiliary display device, the information including an indication of one or more display features and one or more user interface controls of the second auxiliary display device, the user interface controls indication including a number and type of inputs available on the second auxiliary display device;

receive from at least one of a plurality of computer programs a function call configured to display information on each of the first and second auxiliary display devices coupled to the computer system, the at least one of a plurality of computer programs being configured to send a variable, selectable amount of information to each of the auxiliary display devices, depending on the indicated display features and the indicated user interface controls of each auxiliary display device, such that the auxiliary display service is configured to output different portions of display information from the same computer program to each of the first and second auxiliary display devices, wherein the portions of display information are based on each device'"'"'s indicated display features and indicated user interface controls;

based on the received display features and user interface control information from the first auxiliary display device, tailor the information that is to be displayed on the first auxiliary display device as a result of the function call based on the first auxiliary device'"'"'s indicated display features and indicated user interface controls, such that each portion of the information that is displayable according to the available display features is displayed in a manner corresponding to the first auxiliary display device'"'"'s display features and is navigable using each of the first auxiliary display device'"'"'s user interface controls; and

based on the received display features and user interface control information from the second auxiliary display device, tailor the information that is to be displayed on the second auxiliary display device as a result of the function call based on the second auxiliary device'"'"'s indicated display features and indicated user interface controls, such that each portion of the information that is displayable according to the available display features is displayed in a manner corresponding to the second auxiliary display device'"'"'s display features and is navigable using each of the second auxiliary display device'"'"'s user interface controls; and

an offline interaction manager configured to perform the following upon detecting that the computer system is turned off or is in a standby/hibernate state;

store the tailored information for the first auxiliary display device in a system cache;

store the tailored information for the second auxiliary display device in the system cache;

upon receiving navigation inputs at the first auxiliary display device via the first auxiliary display device'"'"'s user interface controls, determine which portion of the tailored information stored for the first auxiliary display device is to be displayed on the first auxiliary display device based on which navigation inputs were received;

upon receiving navigation inputs at the second auxiliary display device via the second auxiliary display device'"'"'s user interface controls, determine which portion of the tailored information stored for the second auxiliary display device is to be displayed on the second auxiliary display device based on which navigation inputs were received;

send the determined portion of stored tailored information for the first auxiliary display device to the first auxiliary display device; and

send the determined portion of stored tailored information for the second auxiliary display device to the second auxiliary display device.

33. The system of claim 32 wherein the auxiliary device service receives program data from a computer program running on the computer system and uses the selected protocol component to communicate the data to the auxiliary display for presenting information on the auxiliary display device.

34. The system of claim 32 wherein at least one of the auxiliary display devices receives a command corresponding to an actuator associated with the auxiliary display device that received the command, and uses the selected protocol component to communicate the command to program data within a computer program running on the computer system.