Method and apparatus for keyhole video frame transmission during a communication session

• US 20050192052A1
• Filed: 02/27/2004
• Published: 09/01/2005
• Est. Priority Date: 02/27/2004
• Status: Active Grant

• Current Assignee: HMD Global Oy
• Original Assignee: Nokia Corporation
• Inventors: Tenhunen, Jouko
• Granted Patent: US 7,398,316 B2
• Time in Patent Office: Days
• US Class Current: 455/557
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method and apparatus allows keyhole frame images to be transmitted to a receiving terminal during a communication session. The keyhole frame is movable and resizable throughout the display of the hosting terminal, whereby the image captured by the keyhole frame is transmitted to the receiving terminal during the communication session. The transmitted image may be combined at the receiving terminal with voice or other transmissions from other independent sources to form an integrated communication session. Modifications to the image may be directed by the receiving terminal either through voice commands sent to the hosting terminal from the receiving terminal, or alternatively through cursor/pointing device commands actuated from the receiving terminal itself. All modifications effected on the keyhole frame image at the hosting terminal are viewed in real time at the receiving terminal.

Claims

1. A method of exchanging data between participants of a communication session, comprising:

establishing a voice connection between participants of the communication session;

activating a keyhole frame within a display of a hosting terminal that is in proximity to a first participant;

establishing a stream connection between the first participant and a second participant;

streaming image data contained within the keyhole frame from the hosting terminal to a mobile terminal proximately located to the second participant via the stream connection; and

establishing data connections between ones of the participants of the communication session and the mobile terminal.

2. The method according to claim 1, wherein activating the keyhole frame comprises defining an area within the display of the hosting terminal to represent the keyhole frame.

3. The method according to claim 2, wherein activating the keyhole frame further comprises positioning the keyhole frame within length and width constraints of the display of the hosting terminal.

4. The method according to claim 3, wherein positioning the keyhole frame comprises centering the keyhole frame around an active cursor of the hosting terminal.

5. The method according to claim 3, further comprising modifying the keyhole frame after activation of the keyhole frame.

6. The method according to claim 5, wherein modifying the keyhole frame comprises issuing modification commands from the mobile terminal to change the contents of the keyhole frame.

7. The method according to claim 6, wherein issuing modification commands comprises sending verbal commands from the second participant to the first participant via the voice connection, wherein the first participant modifies the keyhole frame in response to the verbal commands.

8. The method according to claim 6, wherein issuing modification commands comprises sending cursor control commands from the mobile terminal to the hosting terminal, wherein the first participant has previously granted modification rights to the second participant.

9. The method according to claim 5, wherein modifications made to the contents of the keyhole frame are reflected in the image data streamed from the hosting terminal to the mobile terminal.

10. A keyhole frame processing system, comprising:

first and second mobile terminals wirelessly adapted to establish a voice connection between them; and

a hardware platform wirelessly coupled to the second mobile terminal and adapted to establish a data connection between the second mobile terminal and the hardware platform, the hardware platform comprising;

a display; and

a keyhole frame application adapted to place a keyhole frame anywhere within a viewable area of the display and further adapted to transmit image data contained within the keyhole frame to the second mobile terminal via the data connection.

11. The keyhole frame processing system according to claim 10, wherein the second mobile terminal transmits edit commands to the hardware platform affecting the image data contained within the keyhole frame.

12. The keyhole frame processing system according to claim 11, wherein the edit commands comprise voice commands transmitted from the second mobile terminal to the first mobile terminal via the voice connection.

13. The keyhole frame processing system according to claim 11, wherein the edit commands comprise cursor commands transmitted from the second mobile terminal to the hardware platform via the data connection.

14. The keyhole frame processing system according to claim 10, wherein the image data is reflected to a display of the second mobile terminal.

15. The keyhole frame processing system according to claim 11, wherein the image data affected by the edit commands is reflected to a display of the second mobile terminal.

16. A mobile terminal capable of being wirelessly coupled to a network which includes a hardware platform capable of transmitting video content to the mobile terminal, the mobile terminal comprising:

a memory capable of storing at least a keyhole frame module;

a processor coupled to the memory and configured by the keyhole frame module to enable projection of the video content to a display of the mobile terminal; and

a transceiver configured to facilitate the image exchange with the hardware platform, wherein the keyhole frame module is further adapted to generate edit commands to change the video content displayed by the mobile terminal.

17. The mobile terminal according to claim 16, wherein the transceiver is further configured to transmit the edit commands over a voice channel.

18. The mobile terminal according to claim 16, wherein the transceiver is further configured to transmit the edit commands over a data channel.

19. A computer-readable medium having instructions stored thereon which are executable by a mobile terminal for exchanging video content with a hardware platform by performing steps comprising:

establishing a first connection with a second mobile terminal to provide voice communications between the mobile terminal and the second mobile terminal;

establishing a second connection with the hardware platform;

receiving video data from the hardware platform via the second connection; and

providing commands to the hardware platform that affect the video data received from the hardware platform, wherein the commands are provided via one of the first connection or second connection.

20. A hardware platform, comprising:

means for establishing first and second connections with a mobile terminal;

means for exchanging voice communications with the mobile terminal via the first connection;

means for generating video data contained within a keyhole frame, the keyhole frame being defined by keyhole frame parameters to lie within a display region of the hardware platform; and

means for providing the video data to the mobile terminal via the second connection.

21. The hardware platform according to claim 20, further comprising means for receiving commands to change the keyhole frame parameters.

22. The hardware platform according to claim 21, wherein the keyhole frame parameters includes a position of an active cursor within the display region of the hardware platform, wherein the keyhole frame is centered around the position of the active cursor.

23. A computer-readable medium having instructions stored thereon which are executable by a hardware platform by performing steps comprising:

establishing first and second connections with a mobile terminal;

exchanging voice communications with the mobile terminal via the first connection;

generating video data contained within a keyhole frame, the keyhole frame being defined by keyhole frame parameters to lie within a display region of the hardware platform; and

providing the video data to the mobile terminal via the second connection, wherein external commands are received that change the keyhole frame parameters.