Method and apparatus for controlling multimedia contents in realtime fashion

• US 20120113029A1
• Filed: 07/18/2011
• Published: 05/10/2012
• Est. Priority Date: 11/05/2010
• Status: Active Grant

• Current Assignee: Bluespace Corporation
• Original Assignee: Bluespace Corporation
• Inventors: Ye, Zhou, Liu, Pei-Chuan, Lu, Ying-Ko, Huang, San-Yuan, Wei, Yun-Fei
• Granted Patent: US 8,605,048 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information

Abstract

The present invention discloses a method for controlling in realtime fashion multimedia contents on a second screen at a TX side from a first screen at a RX side. The method comprising: detecting at least one touch signal via the first screen, and converting the at least one touch signal into touch data associated with a first position information defining a virtual operation on the first screen corresponding to an actual operation on the second screen, the first position information being with respect to a first coordinate system of the first screen; transmitting the touch data of the RX side to the TX side via the network communication, and calculating at the TX side a second position information with respect to a second coordinate system of the second screen based on the first position information; and performing the actual operation at the second screen based on the second position information.

Claims

1. A method for controlling in realtime fashion multimedia contents on a second screen on a transmit (TX) side from a first screen on a receive (RX) side wherein the multimedia contents comprises audio and video streams and is originated from the TX side and then is sent to the RX side via a network communication;

and wherein the first screen is a touch panel, the method comprising;

detecting at least one touch signal via the first screen, and converting the at least one touch signal into touch data associated with a first position information defining a virtual operation on the first screen corresponding to an actual operation on the second screen, the first position information being with respect to a first coordinate system of the first screen;

transmitting the touch data from the RX side to the TX side via the network communication, and calculating on the TX side a second position information with respect to a second coordinate system of the second screen based on the first position information; and

performing the actual operation at the second screen based on the second position information, so as to allow the RX side to control in realtime fashion the multimedia contents at the TX side.

2. The method of claim 1, wherein the multimedia contents is compressed at a compression ratio on the TX side and decompressed at a decompressed ratio determined by the compression ratio on the RX side.

3. The method of claim 2 further comprising:

detecting a bandwidth of the network communication so as to determine the compression and decompression ratios of the multimedia content.

4. The method of claim 1, further comprising:

detecting at least one motion event from a motion sensor of the touch panel at the RX side;

transmitting at least one sensor data corresponding to at least one motion event to the TX side via a wireless network communication; and

disabling sensor data generated from a motion sensor at the TX side in response to the detecting and then converting the sensor data generated from the RX side to motion data at the TX side, so as to present the multimedia contents on the second screen and subsequently on the first screen in a same particular orientation, the particular orientation being determined by the motion data.

5. The method of claim 4, wherein the particular orientation is a portrait orientation.

6. The method of claim 4, wherein the particular orientation is a landscape orientation.

7. The method of claim 4, wherein the motion data comprises a translation representative of linear acceleration in three-axis directions.

8. The method of claim 4, wherein the motion data comprises an angular rotation representative of Yaw, Roll and Pitch in three-axis directions.

9. The method of claim 4, wherein the motion sensor is selected from the group consisting of an accelerometer, a gyroscope and a magnetic compass.

10. The method of claim 9, wherein each the motion sensor has a plurality of sensing ranges.

11. The method of claim 9, wherein each the motion sensor has a particular sensing range.

12. The method of claim 2, wherein the RX side is provided in a CPU-less and/or GPU-less environment.

13. The method of claim 10, further comprising:

detecting whether a switch signal is invoked by a switch element operative to a user at the RX side, and issuing an adjustment signal to a motion chip at the RX side in response to the invoked switch signal; and

selecting one of the plurality of sensing ranges of the motion chip based on the adjustment signal; and

generating the motion data by the motion chip based on the selected sensing range so as to enable an interaction between the RX side and the TX side.

14. The method of claim 10, further comprising:

detecting whether a switch signal is invoked by an application program at the TX side, and issuing an adjustment signal to a motion chip at the RX side in response to the invoked switch signal;

selecting one of the plurality of sensing ranges of the motion chip based on the adjustment signal; and

generating the motion data by the motion chip based on the selected sensing range so as to enable an interaction between the RX side and the TX side.

15. The method of claim 11, further comprising:

detecting whether a switch signal is invoked by an application program at the TX side, and issuing an adjustment signal in response to the invoked switch signal; and

adjusting a threshold value of the application program by means of increasing the threshold value at a ratio corresponding to the adjustment signal so as to enable an interaction between the RX side and the TX side.

16. The method of claim 11, further comprising:

detecting whether a switch signal is invoked by an application program at the TX side, and issuing an adjustment signal in response to the invoked switch signal; and

adjusting a magnitude of the motion data by means of increasing the magnitude'"'"'s value at a ratio corresponding to the adjustment signal so as to enable an interaction between the RX side and the TX side.

17. The method of claim 10, wherein one of the plurality of sensing ranges is selected by a control code so as to enable a motion chip to generate the at least one motion data based on the selected sensing range.

18. The method of claim 1, further comprising:

(a) detecting an event of a charging connection between the TX side and the RX side;

(b) retrieving first and second remaining battery amounts respectively from first battery cells on the TX side and second battery cells on the RX side;

(c) comparing the two remaining battery amounts with two predetermined battery capacity percentages by a power management mechanism so as to select one of the following steps;

(c-1) sending a first message of recharging information when each of the remaining battery amounts is below the predetermined battery capacity percentage thereof;

(c-2) sending a second message of recharging information when the remaining battery amount of the RX side is higher than its predetermined battery capacity percentage, and simultaneously the remaining battery amount of the RX side is higher than that of the TX side;

or

(c-3) sending a third message of recharging information when the remaining battery amount of the TX side is higher than its predetermined battery capacity percentage, and simultaneously the remaining battery amount of the TX side is higher than that of the RX side; and

(d) implementing a charging operation between the TX and RX sides if an occurrence of one of the recharging messages is determined.

19. The method of claim 1, further comprising:

(a) detecting an event of a charging connection between the TX side and the RX side;

(b) retrieving first and second remaining battery amounts respectively from first battery cells on the TX side and second battery cells on the RX side;

(c) presenting a user interface to allow a user'"'"'s selection of battery charging;

(d) comparing the two remaining battery amounts with two predetermined battery capacity percentages by a power management mechanism so as to select one of the following steps;

(d-1) sending a first message of recharging information when each of the remaining battery amounts is below the predetermined battery capacity percentage thereof;

(d-2) sending a second message of recharging information when the remaining battery amount of the RX side is higher than its predetermined battery capacity percentage, and simultaneously the remaining battery amount of the RX side is higher than that of the TX side;

or

(d-3) sending a third message of recharging information when the remaining battery amount of the TX side is higher than its predetermined battery capacity percentage, and simultaneously the remaining battery amount of the TX side is higher than that of the RX side; and

(e) implementing a charging operation between the TX and RX sides if an occurrence of one of the recharging messages is determined.

20. A method for controlling in realtime fashion multimedia contents between a receive (RX) side having a first touch panel and a transmit (TX) side having a second touch panel via a network communication, wherein the multimedia contents comprises at least a screen frame data, the method comprising:

detecting at least one touch signal from the second touch panel;

in response to detecting the touch signal from the second touch panel, compressing the screen frame data on the TX side and transmitting to the RX side so that the RX side decompresses the compressed screen frame data so as to obtain a TX'"'"'s resolution data, wherein the TX'"'"'s resolution data is provided together with a RX'"'"'s resolution data to scale the screen frame data so as to display the screen frame data to fit with the RX'"'"'s touch panel;

detecting at least one touch signal from the first touch panel;

in response to detecting the touch signal from the first touch panel, converting the touch signal on the RX side into touch data associated with a first position information defining a virtual operation on the first screen corresponding to an actual operation on the second screen, the first position information being with respect to a first coordinate system of the first screen;

transmitting the touch data from the RX side to the TX side via the network communication, and calculating on the TX side a second position information with respect to a second coordinate system of the second screen based on the first position information, and performing the actual operation at the second screen based on the second position information; and

implementing an override mechanism to assign the TX side a higher priority overriding the RX side when the two detecting events occur simultaneously.