Orientation adjustment for casting videos

• US 9,723,258 B2
• Filed: 12/30/2015
• Issued: 08/01/2017
• Est. Priority Date: 12/30/2015
• Status: Active Grant

• Current Assignee: Roku, Inc.
• Original Assignee: Roku, Inc.
• Inventors: Gates, Gregory S.
• Primary Examiner(s): Tran, Trang U
• Application Number:
  US14/984,526
• Publication Number:
  US 20170195620A1
• Time in Patent Office: 580 Days
• Field of Search: 348441, 348583
• CPC Class Codes: H04N 19/112 according to a given display mode, e.g. for interlaced or progressive display mode
• CPC Class Codes: H04N 19/16 for a given display mode, e.g. for interlaced or progressive display mode
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/234336 by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 7/0117 involving conversion of the spatial resolution of the incoming video signal for graphics images G09G2340/0407

Abstract

System, method, and computer product embodiments for proving an orientation adjustment for casting visual content on a display device are described. A computing device selects an orientation adjustment to be used in transcoding a video having a frame and assigned an orientation. The computing device requests a transcoder within the computing device to transcode the frame based on the orientation adjustment to generate a transcoded frame. The transcoded frame is converted into a format comparable to a reference frame representing the frame that is corrected transcoded to the assigned orientation. Then, the computing device compares the converted frame with the reference frame to determine that the frame is transcoded correctly to the assigned orientation. If the frame is transcoded correctly, the computing device uses the selected orientation adjustment when transcoding visual content for casting or streaming on a display device in an orientation matching that of the visual content.

Claims

1. A method, comprising:

receiving, by a computing device, a video and a reference frame, wherein the video includes a video frame and wherein the reference frame has a reference frame orientation;

applying, by the computing device, an orientation adjustment to the video frame;

requesting, by the computing device, a transcoder within the computing device to transcode the video frame based on the orientation adjustment to generate a transcoded frame;

converting, by the computing device, the transcoded frame into a converted frame having a converted frame orientation and a format comparable to the reference frame;

comparing, by the computing device, the converted frame with the reference frame to determine that the converted frame orientation is the same as the reference frame orientation; and

in response to determining that the converted frame orientation is the same as the reference frame orientation, using, by the computing device, the applied orientation adjustment when transcoding visual content with the transcoder to generate a corresponding transcoded visual content that casts on a display device in an orientation matching that of the visual content.

2. The method of claim 1, wherein the applying further comprises:

checking whether an orientation setting within the computing device is set, the orientation setting indicating information used in transcoding visual content for casting on the display device; and

initiating the applying when the orientation setting is unset.

3. The method of claim 2, further comprising:

upon the comparing, storing the orientation adjustment in the orientation.

4. The method of claim 1, wherein the requesting comprises:

sending the orientation adjustment as a parameter to the transcoder; and

sending the video frame to the transcoder that transcodes the frame using the orientation adjustment to generate the transcoded frame.

5. The method of claim 1, wherein the requesting comprises:

applying the orientation adjustment to the video frame before sending the orientation-adjusted frame to the transcoder that generates the transcoded frame.

6. The method of claim 1, wherein the video frame is in a bitmap representation, and wherein the transcoded frame is converted into a vector representation.

7. The method of claim 1, wherein the comparing is performed by a software application on the computing device, the method further comprising:

initiating the comparing when the software application is installed or updated on the computing device.

8. The method of claim 1, wherein the transcoder is provided by an operating system of the computing device, and wherein the requesting is performed via an application programming interface provided by the operating system.

9. The method of claim 2, further comprising:

clearing the orientation setting when the transcoder is updated.

10. The method of claim 1, wherein the reference frame is content that is distinct across each possible rotation of the reference frame.

11. The method of claim 1, wherein the visual content is an image or a video stored in memory of the computing device, and wherein the visual content is stored in a resolution incompatible for casting on the display device.

12. The method of claim 1, further comprising:

in response to determining that the converted frame orientation is different than the reference frame orientation, using, by the computing device, an orientation adjustment different from the applied orientation adjustment when transcoding visual content with the transcoder to generate a corresponding transcoded visual content that casts on a display device in an orientation matching that of the visual content.

13. A system, comprising:

a memory; and

at least one processor coupled to the memory and configured to;

receive a video and a reference frame, wherein the video includes a video frame and wherein the reference frame has a reference frame orientation;

apply an orientation adjustment to the video frame;

request a transcoder within the computing device to transcode the video frame based on the orientation adjustment to generate a transcoded frame,

convert the transcoded frame into a converted frame having a converted frame orientation and a format comparable to the reference frame;

compare the converted frame with the reference frame to determine that the converted frame orientation is the same as the reference frame orientation; and

in response to determining that the converted frame orientation is the same as the reference frame orientation, using the applied orientation adjustment when transcoding visual content with the transcoder to generate a corresponding transcoded visual content that casts on a display device in an orientation matching that of the visual content.

14. The system of claim 13, wherein the at least one processor is further configured to apply by:

checking whether an orientation setting within the memory is set, the orientation setting indicating information used in transcoding visual content for casting on the display device; and

initiating the applying when the orientation setting is unset.

15. The system of claim 14, wherein the at least one processor is further configured to:

upon the compare, store the orientation adjustment in the orientation.

16. The system of claim 13, wherein the at least one processor is further configured to request by:

sending the orientation adjustment as a parameter to the transcoder; and

sending the video frame to the transcoder that transcodes the frame using the orientation adjustment to generate the transcoded frame.

17. The system of claim 13, wherein the at least one processor is further configured to request by:

applying the orientation adjustment to the video frame before sending the orientation-adjusted frame to the transcoder that generates the transcoded frame.

18. The method of claim 13, wherein the video frame is in a bitmap representation, and wherein the transcoded frame is converted into a vector representation.

19. The system of claim 13, wherein the comparing is performed by a software application stored in the memory, and wherein the at least one processor is further configured to:

initiate the comparing when the software application is installed or updated on the computing device.

20. The system of claim 13, wherein the transcoder is provided by an operating system stored in memory, and wherein the request is performed via an application programming interface provided by the operating system.

21. The system of claim 14, wherein the at least one processor is further configured to:

clear the orientation setting when the transcoder is updated.

22. The system of claim 13, wherein the reference frame is content that is distinct across each possible rotation of the reference frame.

23. The system of claim 13, wherein the visual content is an image or a video stored in memory of the computing device, and wherein the visual content is stored in a resolution incompatible for casting on the display device.

24. The system of claim 13, wherein the at least one processor is further configured to:

in response to determining that the converted frame orientation is different than the reference frame orientation, use an orientation adjustment different from the applied orientation adjustment when transcoding visual content with the transcoder to generate a corresponding transcoded visual content that casts on a display device in an orientation matching that of the visual content.

25. A tangible computer-readable device having instructions stored thereon that, when executed by at least one computing device, causes the at least one computing device to perform operations comprising:

receiving, by a computing device, a video and a reference frame, wherein the video includes a video frame and wherein the reference frame has a reference frame orientation;

applying, by the computing device, an orientation adjustment to the video frame;

requesting, by the computing device, a transcoder within the computing device to transcode the video frame based on the orientation adjustment to generate a transcoded frame;

converting, by the computing device, the transcoded frame into a converted frame having a converted frame orientation and a format comparable to the reference frame;

comparing, by the computing device, the converted frame with the reference frame to determine that the converted frame orientation is the same as the reference frame orientation; and

in response to determining that the converted frame orientation is the same as the reference frame orientation, using, by the computing device, the applied orientation adjustment when transcoding visual content with the transcoder to generate a corresponding transcoded visual content that casts on a display device in an orientation matching that of the visual content.