Method and apparatus for remote vehicle screen operation

• US 9,755,976 B2
• Filed: 12/10/2014
• Issued: 09/05/2017
• Est. Priority Date: 12/10/2014
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Bai, Fan, Shan, Dan, Grimm, Donald K., Osella, Massimo
• Primary Examiner(s): Abdul-Ali, Omar
• Application Number:
  US14/565,708
• Publication Number:
  US 20160170619A1
• Time in Patent Office: 1,000 Days
• CPC Class Codes: H04L 47/22 Traffic shaping
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 69/24 Negotiation of communication capabilities

Abstract

A method of remotely controlling a graphic display unit. Requesting, by a host system, assistance of a remote system relating to a respective application, host system including at least one host graphic display unit displaying operational graphics relating to a dedicated application of the host system. The at least one host graphic display unit of the host system is accessed by the remote system. Graphical application data relating to the respective application display is transmitted from the remote system to the host system. Instructional graphic information is projected on the at least one host graphics display unit. Remotely controlling, by the remote system, the at least one host vehicle graphic display unit by displaying to a user of the host system instructional information relating to the respective application. An adaptive session protocol controls a speed in which data is transmitted from the remote system to the host system.

Claims

1. A method of remotely controlling a graphic display unit comprising the steps of:

requesting, by a host system, assistance of a remote system relating to a respective application, the host system including at least one host graphic display unit displaying operational graphics relating to a dedicated application of the host system, the remote system including a remote graphical display unit, the remote system is in wireless communication with the host system;

accessing the at least one host graphic display unit of the host system by the remote system;

transmitting from the remote system to the host system graphical application data relating to the respective application display;

projecting instructional graphic information on the at least one host graphics display unit; and

remotely controlling, by the remote system, the at least one host graphic display unit by displaying to a user of the host system instructional information relating to the respective application;

wherein an adaptive session protocol controls a speed in which data is transmitted from the remote system to the host system, and

wherein the adaptive session protocol applies a framebuffer for controlling a sampling rate at which data is transmitted by the remote system to the host system.

2. The method of claim 1, wherein the instructional graphic information projected on the host graphics display unit is projected as new content.

3. The method of claim 1, wherein the instructional graphic information projected on the host graphics display unit is projected as an overlay to existing content.

4. The method of claim 1, wherein the sampling rate of the framebuffer is dynamically adjusted according to packet indices at a transport layer of the host system.

5. The method of claim 4, wherein the host system communicates a request to the remote system to transmit additional data in response to data in the framebuffer being consumed.

6. The method of claim 5, wherein no data is transmitted in response to no status communication update between host system and the remote system.

7. The method of claim 4, wherein the sampling rate of the framebuffer is increased in response to a difference between an index of a current outgoing packet in the host system transport layer and an index of a most recent acknowledgement of a packet in the host system transport layer being substantially constant for a predetermined period of time.

8. The method of claim 4, wherein the dynamic adjustment of the sampling rate is determined by the following formula:

(P₀−

P₁)<

C₀ for K_I_INTERVAL sec

where P₀ is the index of the current outgoing packet, and where P₁ is the index of the most recent acknowledged packet, C₀ is a maximum (P₀−

P₁) during a sample interval, and K_I_INTERVAL is a calibratable constant that specifies the interval required to increase the sampling rate.

9. The method of claim 8, wherein the sampling rate is increased by a multiple of the previous sampling rate.

10. The method of claim 8, wherein the sampling rate of the framebuffer is decreased in response to the difference between the index of a current outgoing packet in the host system transport layer and an index of a most recent acknowledgement of a packet in the host system transport layer increasing after a second predetermined period of time.

11. The method of claim 10, wherein the dynamic adjustment for decreasing the sampling rate is determined by the following formula:

(P₀−

P₁)<

C₀ for K_D_INTERVAL sec

where K_D_INTERVAL is a sample interval that is a calibratable constant that specifies the interval required to decrease the sampling rate.

12. The method of claim 11, wherein the sampling rate is a fraction of the previous sampling rate.

13. The method of claim 11, wherein the respective application which assistance is requested is an application different than the dedicated application primarily utilized on the host graphics display unit.

14. The method of claim 11, further comprising the steps of:

requesting assistance of a remote system by a host system relating to the dedicated application displayed on the host graphic display unit;

accessing the at least one host graphic display unit of the host system by the remote system;

transmitting from the host system to the remote system graphical application data relating to the dedicated application displayed on a targeted host graphic display unit;

projecting the graphical application data on the remote graphic display unit;

remotely controlling, by the remote system, features of the dedicated application, the host graphic display unit displaying or overlaying instructional operations of the dedicated application as controlled by the remote system;

wherein the adaptive session protocol controls the sampling rate in which data related to the dedicated application displayed on the host system is transmitted from the host system to the remote system.

15. The method of claim 14, wherein a host display client/server functions as a server, and a remote display client/server functions as a client when application data is transmitted from the host system to the remote system.

16. The method of claim 15, wherein a host graphic codec solution provides an interface between the host graphic display unit host display client/server, the host graphic codec solution encoding application data prior to transmission to the remote system, and wherein the remote graphic codec solution provides an interface between the remote graphics display unit and the remote display client/server, the remote graphic codec solution decoding application data received from the host system.

17. The method of claim 11, wherein a host display client/server functions as a client, and a remote client/server functions as a server when application data is transmitted from the remote vehicle to the host vehicle.

18. The method of claim 17, wherein a remote graphic codec solution provides an interface between the remote graphics display unit and the remote display client/server, the remote graphic codec solution encoding application data prior to transmission to the host system, and wherein the host graphic codec solution provides an interface between the host graphics display unit and the host display client/server, the host graphic codec solution decoding application data received from the remote system.

19. The method of claim 1, wherein application data is transmitted wirelessly between the host system and remote system.

20. The method of claim 1, wherein wireless communication between the host system and remote system utilizes a long term evolution data pipe for data transmission.

21. The method of claim 1, wherein the host system includes a mobile vehicle, and the remote system includes a fixed infrastructure.