Selective mirroring of media output

• US 9,008,177 B2
• Filed: 12/12/2011
• Issued: 04/14/2015
• Est. Priority Date: 12/12/2011
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Rabii, Khosro M.
• Primary Examiner(s): Kim, Hee-Yong
• Application Number:
  US13/323,399
• Publication Number:
  US 20130148720A1
• Time in Patent Office: 1,219 Days
• Field of Search: 375/240.12
• US Class Current: 375/240.12
• CPC Class Codes: G06F 2209/545 Gui
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G09G 2360/04 Display device controller operating with a plurality of display units

Abstract

According to some aspects, this disclosure describes techniques for mirroring native media output of a source device via a different destination device. According to the techniques described herein, the source device may control the destination device to the media via an output interface associated with the destination device. The source device may receive a media element of the native media. In response to receiving the native media element, the source device may determine whether to output (mirror) the native media including the media element based on at least one parameter associated with the media element. According to other aspects, this disclosure describes techniques for preventing at least one media element from being mirrored via a destination device operating to mirror other native media. As one example, the source device may change how the source device encodes at least one region associated with the media element, in order to freeze media output associated with the at least one region.

Claims

1. A method for mirroring native media of a source device via a destination device, the method comprising:

receiving a first media element of the native media of the source device;

causing the destination device to mirror the native media comprising the first media element via an output interface associated with the destination device;

receiving a second media element of the native media of the source device;

determining whether to cause the destination device to mirror the native media including the second media element based on at least one parameter associated with the second media element;

in response to determining to cause the destination device to not mirror the second media element, identifying a region of the native media that corresponds to the second media element; and

causing the destination device to display, in the identified region, image data of a previous frame of image data, wherein causing the destination device to display the image data of the previous frame of video data prevents the destination device from displaying the second media element.

2. The method of claim 1, wherein the at least one parameter is based on user input.

3. The method of claim 2, wherein the at least one parameter is based on previously received user input stored in memory.

4. The method of claim 2, wherein the at least one parameter is based on dynamically determined user input received in response to receiving the second media element.

5. The method of claim 4, further comprising:

in response to receiving the second media element from at least one software application, providing a user with a user interface that enables the user to indicate whether to control the destination device to mirror the second media element.

6. The method of claim 1, further comprising:

causing the destination device to not mirror the second media element until it is determined whether to mirror the second media element based on the at least one parameter.

7. The method of claim 6, further comprising:

causing the destination device to mirror other native media including the first media element while causing the destination device to not mirror the second media element.

8. The method of claim 7, wherein causing the destination device to mirror other native media including the first media element while causing the destination device to not mirror the second media element comprises:

causing the destination device to mirror the first media element, including reading at least some previously output media stored in memory.

9. The method of claim 7, wherein causing the destination device to mirror other native media including the first media element while causing the destination device to not mirror the second media element comprises:

sending, to the destination device, the media that includes the first media element, and does not include the second media element.

10. The method of claim 9, wherein the media comprises video media, and

wherein causing the destination device to mirror other native media including the first media element while causing the destination device to not mirror the second media element comprises:

encoding the native media to generate mirrored media to be mirrored by the destination device, wherein encoding the native media comprises;

assigning one of a plurality of prediction modes to a plurality of blocks of video data outside of the identified region; and

assigning a skip prediction mode to each of the plurality of blocks within the identified region of the media; and

outputting the frame of video data to a destination device to cause the identified at least one region to be visually frozen in the frame when the frame is output via the destination device.

11. The method of claim 10, wherein assigning one of a plurality of prediction modes to a plurality of blocks of video data outside of the identified region comprises assigning one or more prediction modes selected from the group consisting of:

a split mode;

the skip mode;

a direct mode;

an intra mode; and

an inter mode.

12. The method of claim 1, wherein receiving the first media element and receiving the second media element comprises receiving the first and second media elements from one or more software applications executing on at least one computing device.

13. The method of claim 12, wherein the at least one software application comprises one or more software applications selected from the group consisting of:

a video playback application;

a photo viewing application;

an audio playback application;

a telephone application;

a text messaging application;

an electronic mail (email) application; and

a game application.

14. A source device configured to mirror native media of the source device via a destination device, comprising:

a mirroring module configured to;

receive a first media element of the native media of the source device;

cause a destination device to mirror the native media comprising the first media element via an output interface associated with the destination device;

receive a second media element of the native media;

determine whether to cause the destination device to mirror the native media including the second media element based on at least one parameter associated with the second media element;

in response to determining to cause the destination device to not mirror the second media element, identify a region of the native media that corresponds to the second media element; and

cause the destination device to display, in the identified region, image data of a previous frame of image data, wherein the source device causes the destination device to display the image data of the previous frame of video data to prevent the destination device from displaying the second media element.

15. The device of claim 14, wherein the at least one parameter is based on user input.

16. The device of claim 15, wherein the at least one parameter is based on previously received user input stored in memory.

17. The device of claim 15, wherein the at least one parameter is based on dynamically determined user input received in response to receiving the second media element.

18. The device of claim 17, wherein the mirroring module is further configured to:

in response to receiving the second media element from at least one software application, provide a user with a user interface that enables the user to indicate whether to control the destination device to mirror the second media element.

19. The device of claim 14, wherein the mirroring module is further configured to:

cause the destination device to not mirror the second media element until it is determined whether to mirror the second media element based on the at least one parameter.

20. The device of claim 19, wherein the mirroring module is further configured to:

cause the destination device to mirror other native media including the first media element while causing the destination device to not mirror the second media element.

21. The device of claim 20, wherein the mirroring module is further configured to:

cause the destination device to mirror the first media element, based on reading at least some previously output media stored in memory.

22. The device of claim 19, wherein the mirroring module is further configured to:

send, to the destination device, the media that includes the first media element, and does not include the second media element.

23. The device of claim 22, wherein the media comprises video media, and wherein the mirroring module is further configured to:

encode the native media to generate mirrored media to be mirrored by the destination device, including;

assigning one of a plurality of prediction modes to a plurality of blocks of video data outside of the identified region; and

assigning a skip prediction mode to each of the plurality of blocks within the identified region of the media; and

outputting the frame of video data to a destination device to cause the identified at least one region to be visually frozen in the frame when the frame is output via the destination device.

24. The device of claim 23, wherein the mirroring module is further configured to:

assign one of a plurality of prediction modes to each of a plurality of blocks of video data outside of the identified region selected from the group consisting of;

a split mode;

the skip mode;

a direct mode;

an intra mode; and

an inter mode.

25. The device of claim 14, wherein receiving the first media element and receiving the second media element comprises receiving the first and second media elements from one or more software applications executing on at least one computing device, and wherein the at least one software application comprises one or more software applications selected from the group consisting of:

a video playback application;

a photo viewing application;

an audio playback application;

a telephone application;

a text messaging application;

an electronic mail (email) application; and

a game application.

26. A non-transitory, computer-readable storage medium that stores instructions configured to cause a computing device to:

receive a first media element of native media of a source device;

cause a destination device to mirror the native media comprising the first media element via an output interface associated with the destination device;

receive a second media element of the native media; and

determine whether to cause the destination device to mirror the native media including the second media element based on at least one parameter associated with the second media element;

in response to determining to cause the destination device to not mirror the second media element, identify a region of the native media that corresponds to the second media element; and

cause the destination device to display, in the identified region, image data of a previous frame of image data, wherein the computing device causing the destination device to display the image data of the previous frame of video data prevents the destination device from displaying the second media element.

27. The non-transitory, computer-readable storage medium of claim 26, wherein the at least one parameter is based on user input.

28. The non-transitory, computer-readable storage medium of claim 27, wherein the at least one parameter is based on previously received user input stored in memory.

29. The non-transitory, computer-readable storage medium of claim 27, wherein the at least one parameter is based on dynamically determined user input received in response to receiving the second media element.

30. The non-transitory, computer-readable storage medium of claim 29, wherein the instructions further cause the computing device to:

in response to receiving the second media element from at least one software application, provide a user with a user interface that enables the user to indicate whether to control the destination device to mirror the second media element.

31. The non-transitory, computer-readable storage medium of claim 26, wherein the instructions further cause the computing device to:

cause the destination device to not mirror the second media element until it is determined whether to mirror the second media element based on the at least one parameter.

32. The non-transitory, computer-readable storage medium of claim 31, wherein the instructions further cause the computing device to:

cause the destination device to mirror other native media including the first media element while causing the destination device to not mirror the second media element.

33. The non-transitory, computer-readable storage medium of claim 32, wherein the instructions further cause the computing device to:

cause the destination device to mirror the first media element, based on reading at least some previously output media stored in memory.

34. The non-transitory, computer-readable storage medium of claim 32, wherein the instructions further cause the computing device to:

send, to the destination device, the media that includes the first media element, and does not include the second media element.

35. The non-transitory, computer-readable storage medium of claim 34, wherein the instructions further cause the computing device to:

encode the native media to generate mirrored media to be mirrored by the destination device, including;

assigning one of a plurality of prediction modes to a plurality of blocks of video data outside of the identified region; and

assigning a skip prediction mode to each of the plurality of blocks within the identified region of the media; and

outputting the frame of video data to a destination device to cause the identified at least one region to be visually frozen in the frame when the frame is output via the destination device.

36. The non-transitory, computer-readable storage medium of claim 35, wherein the instructions further cause the computing device to assign the one of the plurality of prediction modes selected from the group consisting of:

a split mode;

the skip mode;

a direct mode;

an intra mode; and

an inter mode.

37. The non-transitory, computer-readable storage medium of claim 26, wherein the instructions further cause the computing device to receive the first media element and the second media element comprises from one or more software applications executing on at least computing device, and wherein the at least one software application comprises one or more software applications selected from the group consisting of:

a video playback application;

a photo viewing application;

an audio playback application;

a telephone application;

a text messaging application;

an electronic mail (email) application; and

a game application.

38. A source device configured to mirror native media of the source device via a destination device, comprising:

means for receiving a first media element of the native media of the source device;

means for causing a destination device to mirror the native media comprising the first media element via an output interface associated with the destination device;

means for receiving a second media element of the native media;

means for determining whether to cause the destination device to mirror the native media including the second media element based on at least one parameter associated with the second media element; and

means for identifying a region of the native media that corresponds to the second media element in response to determining to cause the destination device to not mirror the second media element; and

means for causing the destination device to display, in the identified region, image data of a previous frame of image data, wherein the means for causing the destination device to display the image data of the previous frame of video data prevents the destination device from displaying the second media element.

39. The device of claim 38, further comprising:

means for determining the at least one parameter is based on user input.

40. The device of claim 39, further comprising:

means for determining the at least one parameter based on previously received user input stored in memory.

41. The device of claim 39, further comprising:

means for dynamically determining user input received in response to receiving the second media element.

42. The device of claim 41, further comprising:

means for, in response to receiving the second media element from at least one software application, providing a user with a user interface that enables the user to indicate whether to control the destination device to mirror the second media element.

43. The device of claim 41, further comprising:

means for causing the destination device to not mirror the second media element until it is determined whether to mirror the second media element based on the at least one parameter.

44. A method of encoding a frame of video data, the method comprising:

determining whether to cause a destination device to mirror a media element based on at least one parameter associated with the media element;

identifying at least one region of a frame of video data that corresponds to the media element;

assigning one of a plurality of prediction modes to each block of a plurality of blocks of video data in the video frame that reside outside of the identified at least one region; and

in response to determining to cause the destination device to not mirror the media element, assigning a skip prediction mode to each of the plurality of blocks within the identified at least one region; and

outputting the frame of video data to the destination device to cause the identified at least one region to be visually frozen in the frame when the frame is output via the destination device.

45. The method of claim 44, assigning one of a plurality of prediction modes to a plurality of blocks of video data outside of the identified region assigning one or more prediction modes selected from the group consisting of:

a split mode;

the skip mode;

a direct mode;

an intra mode; and

an inter mode.

46. The method of claim 44, wherein identifying the at least one region of the frame of video data comprises identifying the at least one region to prevent the media element from being mirrored via the destination device along with other media native to the source device.

47. The method of claim 44, further comprising:

assigning a skip prediction mode to each of the plurality of blocks within the at least one region comprises assigning the skip prediction mode to each of the blocks regardless of whether there are any differences between a respective block and a predictive block that may be used by a decoder to reconstruct the respective block.

48. A device configured to encode a frame of video data, comprising;

a mirroring module configured to;

determine whether to cause a destination device to mirror a media element based on at least one parameter associated with the media element;

identify at least one region of a frame of video data that corresponds to the media element; and

a video encoder configured to;

assign one of a plurality of prediction modes to each block of a plurality of blocks of video data outside of the identified at least one region; and

in response to determining to cause the destination device to not mirror the media element, assign a skip prediction mode to each of the plurality of blocks within the identified at least one region; and

output the frame of video data to the destination device to cause the identified at least one region to be visually frozen in the frame when the frame is output via the destination device.

49. The device of claim 48, wherein the video encoder is configured to assign one of a plurality of prediction modes to a plurality of blocks of video data outside of the identified region selected from the group consisting of:

a split mode;

the skip mode;

a direct mode;

an intra mode; and

an inter mode.

50. The device of claim 48, wherein the mirroring module is further configured to identify the at least one region of the frame of video data based on identifying the at least one region to prevent media element device from being mirrored via the destination device along with other media native to the source device.

51. The device of claim 48, wherein the video encoder is further configured to:

assign a skip prediction mode to each of the plurality of blocks within the at least one region comprises assigning the skip prediction mode to each of the blocks regardless of whether there are any differences between a respective block and a predictive block that may be used by a decoder to reconstruct the respective block.

52. A non-transitory, computer-readable storage medium that stores instructions configured to cause a computing device to:

determine whether to cause a destination device to mirror a media element based on at least one parameter associated with the media element;

identify at least one region of a frame of video data that corresponds to the media element;

assign one of a plurality of prediction modes to each block of a plurality of blocks of video data outside of the identified at least one region;

in response to determining to cause the destination device to not mirror the media element, assign a skip prediction mode to each of the plurality of blocks within the identified at least one region; and

output the frame of video data to the destination device to cause the identified at least one region to be visually frozen in the frame when the frame is output via the destination device.

53. The non-transitory, computer-readable storage medium of claim 52, wherein the instructions further cause the computing device to:

assign one of a plurality of prediction modes to each of the plurality of blocks of video data outside of the identified region selected from the group consisting of;

a split mode;

the skip mode;

a direct mode;

an intra mode; and

an inter mode.

54. The non-transitory, computer-readable storage medium of claim 52, wherein the instructions further cause the computing device to:

identify the at least one region of the frame of video data to prevent the media element from being mirrored via the destination device along with other media native to the source device.

55. The non-transitory, computer-readable storage medium of claim 52, wherein the instructions further cause the computing device to:

assign the skip prediction mode to each of the blocks within the identified at least one region regardless of whether there are any differences between a respective block and a predictive block that may be used by a decoder to reconstruct the respective block.

56. A device configured to encode a frame of video data, comprising:

means for determining whether to cause a destination device to mirror a media element based on at least one parameter associated with the media element;

means for identifying at least one region of a frame of video data that corresponds to the media element;

means for assigning one of a plurality of prediction modes to each block of a plurality of blocks of video data outside of the identified at least one region; and

means for assigning a skip prediction mode to each of the plurality of blocks within the identified at least one region in response to determining to cause the destination device to not mirror the media element; and

means for outputting the frame of video data to the destination device to cause the identified at least one region to be visually frozen in the frame when the frame is output via the destination device.