Interactive video conferencing

• US 10,165,226 B2
• Filed: 09/20/2017
• Issued: 12/25/2018
• Est. Priority Date: 01/06/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Intel IP Corporation (Intel Corporation)
• Inventors: Oyman, Ozgur
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US15/710,589
• Publication Number:
  US 20180013980A1
• Time in Patent Office: 461 Days
• Field of Search: 345 55, 345428, 348 1402, 348 1408, 348 1409, 348 36, 348 1416, 370237, 370252, 37524008, 37524001, 37524012, 37524026, 707723, 709228, 709230, 709231, 725 25, 725118, 386280
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/4053 without floor control
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/632 using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6437 Real-time Transport Protocol [RTP]
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: Y02D 30/70 in wireless communication networks

Abstract

Technology for a first multimedia telephony services over internet protocol (IP) multimedia subsystems (IMS) (MTSI) client operable to support region of interest (ROI) signaling with a second MTSI client is disclosed. The first MTSI client can identify a requested region of interest (ROI). The first MTSI client can encode the requested ROI for transmission to the second MTSI client via a real-time transport control protocol (RTCP) feedback message. The first MTSI client can decode encoded video received from the second MTSI client that corresponds to the requested ROI.

Claims

1. At least one non-transitory machine readable storage medium having instructions embodied thereon for supporting region of interest (ROI) signaling between a multimedia telephony services over internet protocol (IP) multimedia subsystems (IMS) (MTSI) receiver and a MTSI sender, the instructions when executed perform the following:

identifying, at the MTSI receiver, a requested region of interest (ROI);

encoding, at the MTSI receiver, the requested ROI for transmission to the MTSI sender via a real-time transport control protocol (RTCP) feedback message; and

decoding, at the MTSI receiver, encoded video received from the MTSI sender that corresponds to the requested ROI.

2. The at least one non-transitory machine readable storage medium of claim 1, further comprising instructions when executed perform the following:

decoding a sent ROI that corresponds to the encoded video received from the MTSI sender, wherein the sent ROI is received from the MTSI sender via a real-time transport protocol (RTP) header extension.

3. The at least one non-transitory machine readable storage medium of claim 1, further comprising instructions when executed perform the following:

decoding a session description protocol (SDP) offer message received from the MTSI sender, wherein the SDP offer message indicates that the MTSI sender supports an ROI feature.

4. The at least one non-transitory machine readable storage medium of claim 1, further comprising instructions when executed perform the following:

encoding a session description protocol (SDP) answer message for transmission to the MTSI sender, wherein the SDP answer message acknowledges that the MTSI sender supports an ROI feature.

5. The at least one non-transitory machine readable storage medium of claim 1, wherein the SDP offer message includes:

an RTCP feedback (FB) attribute to signal the requested ROI;

or

an extension map attribute to signal the requested ROI.

6. The at least one non-transitory machine readable storage medium of claim 1, wherein the SDP answer message includes:

an RTCP feedback (FB) attribute to signal the requested ROI;

or

an extension map attribute to signal the requested ROI.

7. The at least one non-transitory machine readable storage medium of claim 1, wherein the RTCP feedback message includes a position and a size that define the ROI.

8. The at least one non-transitory machine readable storage medium of claim 2, wherein the RTP header extension includes a position and a size that defines the sent ROI corresponding to the encoded video received from the MTSI sender.

9. At least one non-transitory machine readable storage medium having instructions embodied thereon for supporting region of interest (ROI) signaling between a multimedia telephony services over internet protocol (IP) multimedia subsystems (IMS) (MTSI) sender and a MTSI receiver, the instructions when executed perform the following:

decoding, at the MTSI sender, a region of interest (ROI) received from the MTSI receiver, wherein the ROI is received via a real-time transport control protocol (RTCP) feedback message

generating, at the MTSI sender, encoded video that corresponds to the ROI received from the MTSI receiver via the RTCP feedback message; and

processing, at the MTSI sender, the encoded video for transmission to the MTSI receiver.

10. The at least one non-transitory machine readable storage medium of claim 9, further comprising instructions when executed perform the following:

encoding an actual ROI for transmission to the MTSI receiver, wherein the actual ROI corresponds to the encoded video, wherein the actual ROI is transmitted via a real-time transport protocol (RTP) header extension.

11. The at least one non-transitory machine readable storage medium of claim 9, further comprising instructions when executed perform the following:

encoding a session description protocol (SDP) offer message for transmission to the MTSI receiver, wherein the SDP offer message indicates that the MTSI sender supports an ROI feature.

12. The at least one non-transitory machine readable storage medium of claim 9, further comprising instructions when executed perform the following:

decoding a session description protocol (SDP) answer message received from the MTSI receiver, wherein the SDP answer message acknowledges support of an ROI feature at the MTSI sender.

13. The at least one non-transitory machine readable storage medium of claim 9, wherein the RTCP feedback message includes a position and a size that define the ROI.

14. An apparatus of a first multimedia telephony services over internet protocol (IP) multimedia subsystems (IMS) (MTSI) client operable to support region of interest (ROI) signaling with a second MTSI client, the apparatus comprising:

memory; and

one or more processors configured to;

identify, at the first MTSI client, a requested region of interest (ROI);

encode, at the first MTSI client, the requested ROI for transmission to the second MTSI client via a real-time transport control protocol (RTCP) feedback message; and

decoding, at the first MTSI client, encoded video received from the second MTSI client that corresponds to the requested ROI.

15. The apparatus of claim 14, wherein the one or more processors are further configured to decode a sent ROI that corresponds to the encoded video received from the second MTSI client, wherein the sent ROI is received from the second MTSI client via a real-time transport protocol (RTP) header extension.

16. The apparatus of claim 14, wherein the one or more processors are further configured to decode a session description protocol (SDP) offer message received from the second MTSI client, wherein the SDP offer message indicates that the second MTSI client supports an ROI feature.

17. The apparatus of claim 14, wherein the one or more processors are further configured to encode a session description protocol (SDP) answer message for transmission from the first MTSI client to the second MTSI client, wherein the SDP answer message acknowledges that the second MTSI client supports an ROI feature.

18. The apparatus of claim 14, wherein the SDP offer message includes:

an RTCP feedback (FB) attribute to signal the requested ROI;

or

an extension map attribute to signal the requested ROI.

19. The apparatus of claim 14, wherein the SDP answer message includes:

an RTCP feedback (FB) attribute to signal the requested ROI;

or

an extension map attribute to signal the requested ROI.

20. The apparatus of claim 14, wherein the RTCP feedback message includes a position and a size that define the ROI.

21. The apparatus of claim 15, wherein the RTP header extension includes a position and a size that defines the sent ROI corresponding to the encoded video received from the second MTSI client.