Method and system for implementing content navigation or selection using touch-based input

• US 10,353,577 B2
• Filed: 04/03/2017
• Issued: 07/16/2019
• Est. Priority Date: 10/04/2016
• Status: Active Grant

• Current Assignee: CenturyLink Intellectual Property LLC (Lumen Technologies, Inc.)
• Original Assignee: CenturyLink Intellectual Property LLC (Lumen Technologies, Inc.)
• Inventors: Ingah, Zubin, Sprenger, Michael D.
• Primary Examiner(s): Brahmachari, Mandrita
• Application Number:
  US15/477,376
• Publication Number:
  US 20180095656A1
• Time in Patent Office: 834 Days
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42208 Display device provided on the remote control
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/43078 for seamlessly watching content streams when changing device, e.g. when watching the same program sequentially on a TV and then on a tablet
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/482 : End-user interface for program selection broadcast systems using EPGs H04H60/72

Abstract

Novel tools and techniques are provided for implementing media content streaming or playback, and, more particularly, for implementing content navigation or selection using touch-based input. In various embodiments, a computing system might display a first video content on a display screen of a main display device and on a touchscreen display of a user device, the first video content displayed on one mirroring that displayed on the other. In response to receiving user input via the touchscreen display, the computing system might shift display of the first video content along a first direction consistent with the user input while displaying and shifting display of a second video content along the first direction such that the two video content are adjacent to each other during shifting. The computing system might mirror the display and the shifting of the display of the first and the second video content on the display screen.

Claims

1. A method, comprising:

displaying, with a computing system, a first video content on at least a portion of a display screen of a main display device;

displaying, with the computing system, the first video content on at least a portion of a touchscreen display of a user device, the first video content being displayed on the at least a portion of the touchscreen display of the user device mirroring the first video content being displayed on the at least a portion of the display screen of the main display device;

receiving, with the computing system, user input via the touchscreen display of the user device, the user input comprising a first swipe in a first direction relative to a reference point on the touchscreen display of the user device;

in response to receiving the user input, shifting, with the computing system, display of the first video content along the first direction on the at least a portion of the touchscreen display while displaying and shifting, with the computing system, display of a second video content along the first direction on the at least a portion of the touchscreen display such that the first video content and the second video content are adjacent to each other while display of the first video content and the second video content are being shifted;

mirroring, with the computing system, the display and the shifting of the display of the first video content and the second video content on the at least a portion of the display screen of the main display device, wherein the first video content and the second video content continue playback as they are being shifted;

determining, with the computing system, whether the second video content fills at least half of the at least a portion of the touchscreen display of the user device;

based on a determination that the second video content fills less than half of the at least a portion of the touchscreen display of the user device, presenting or continuing presenting, with the computing system, first audio content associated with the first video content; and

based on a determination that the second video content fills at least half of the at least a portion of the touchscreen display of the user device, presenting or continuing presenting, with the computing system, second audio content associated with the second video content;

wherein each of the first audio content or the second audio content is presented using at least one of an audio playback device that is integrated within the main display device, an audio playback device that is external yet communicatively coupled to the main display device, an audio playback device that is integrated within the user device, or an audio playback device that is external yet communicatively coupled to the user device.

2. The method of claim 1, wherein the computing system comprises one of a set-top box, a small streaming device, a digital video recording (“

DVR”

) device, a processor on the main display device running a software application (“

app”

), a processor on the user device running an app, a server computer over a network, a cloud-based computing system over a network, a media player, or a gaming console.

3. The method of claim 1, wherein the main display device comprises one of a television set, a smart television, a projection system, a computer monitor, or a laptop monitor.

4. The method of claim 1, wherein the user device comprises one of a laptop computer, a tablet computer, a smart phone, a mobile phone, a personal digital assistant, a remote control device, or a portable gaming device.

5. The method of claim 1, wherein the shifting of the display of each of the first video content or the second video content comprises one of a scrolling effect, a sliding effect, a flipping effect, a transitioning effect, or a dragging effect.

6. The method of claim 1, wherein the shifting of the display of each of the first video content or the second video content comprises dynamic cropping of each of the first video content or the second video content such that the first video content and the second video content maintain their display resolution and size while both are being partially displayed during shifting.

7. The method of claim 1, wherein the first video content is video content that is broadcast on a first broadcast channel, while the second video content is video content that is broadcast on a second broadcast channel.

8. The method of claim 1, wherein the first video content and the second video content are video content among a plurality of video content available for browsing or viewing in one of a video on demand (“

VoD”

) platform, a video streaming platform, or a digital video recording (“

DVR”

) platform.

9. The method of claim 1, wherein mirroring the display and the shifting of the display of the first video content and the second video content on the at least a portion of the display screen of the main display device comprises mirroring, with the computing system, the display and the shifting of the display of the first video content and the second video content on the at least a portion of the display screen of the main display device, in real time or near real time.

10. The method of claim 1, wherein the first direction is one of a vertical direction with respect to a viewing orientation of the first video content or a horizontal direction with respect to the viewing orientation of the first video content.

11. The method of claim 1, wherein the first video content and the second video content are video content among a plurality of video content that are arranged in a grid pattern with one video content being adjacent to eight video content, wherein the first direction is one of a diagonal direction with respect to a viewing orientation of the first video content, wherein, in response to receiving the user input comprising a swipe in the diagonal direction, portions of the plurality of video content in the grid pattern is shifted along the diagonal direction on one or both of the touchscreen display of the user device or the display screen of the main display device.

12. The method of claim 11, further comprising:

receiving, with the computing system, a second user input via the touchscreen display of the user device, the second user input comprising multiple-finger input indicating one of zoom-in or zoom-out;

in response to receiving the second user input, performing, with the computing system, corresponding one of zooming in or zooming out of display of the plurality of video content in the grid pattern on the at least a portion of the touchscreen display; and

mirroring, with the computing system, the corresponding one of zooming in or zooming out of the display of the plurality of video content in the grid pattern on the at least a portion of the display screen of the main display device.

13. The method of claim 11, further comprising:

determining, with the computing system, whether the user has selected one of the plurality of video content;

based on a determination that the user has selected one of the plurality of video content, presenting or continuing presenting, with the computing system, audio content associated with the selected one of the plurality of video content; and

based on a determination that the user has not selected any of the plurality of video content, identifying, with the computing system, which one of the plurality of video content covers a center position of the at least a portion of the touchscreen display, and presenting or continuing presenting, with the computing system, audio content associated with the identified video content that covers the center position of the at least a portion of the touchscreen display;

wherein the audio content is presented using at least one of an audio playback device that is integrated within the main display device, an audio playback device that is external yet communicatively coupled to the main display device, an audio playback device that is integrated within the user device, or an audio playback device that is external yet communicatively coupled to the user device.

14. The method of claim 1, further comprising:

displaying, with the computing system, content information associated with each of at least one of the first video content or the second video content on one or both of the display screen of the main display device or the touchscreen display of the user device, wherein the content information is either displayed overlaid over corresponding at least one of the first video content or the second video content or displayed in a separate portion of the one or both of the display screen of the main display device or the touchscreen display of the user device on which neither the first video content nor the second video content are being displayed.

15. An apparatus, comprising:

at least one processor; and

a non-transitory computer readable medium communicatively coupled to the at least one processor, the non-transitory computer readable medium having stored thereon computer software comprising a set of instructions that, when executed by the at least one processor, causes the apparatus to;

display a first video content on at least a portion of a display screen of a main display device;

display the first video content on at least a portion of a touchscreen display of a user device, the first video content being displayed on the at least a portion of the touchscreen display of the user device mirroring the first video content being displayed on the at least a portion of the display screen of the main display device;

receive user input via the touchscreen display of the user device, the user input comprising a first swipe in a first direction relative to a reference point on the touchscreen display of the user device;

in response to receiving the user input, shift display of the first video content along the first direction on the at least a portion of the touchscreen display while displaying and shifting display of a second video content along the first direction on the at least a portion of the touchscreen display such that the first video content and the second video content are adjacent to each other while display of the first video content and the second video content are being shifted;

mirror the display and the shifting of the display of the first video content and the second video content on the at least a portion of the display screen of the main display device, wherein the first video content and the second video content continue playback as they are being shifted;

determine whether the second video content fills at least half of the at least a portion of the touchscreen display of the user device;

based on a determination that the second video content fills less than half of the at least a portion of the touchscreen display of the user device, present or continue presenting first audio content associated with the first video content; and

based on a determination that the second video content fills at least half of the at least a portion of the touchscreen display of the user device, present or continue presenting second audio content associated with the second video content;

wherein each of the first audio content or the second audio content is presented using at least one of an audio playback device that is integrated within the main display device, an audio playback device that is external yet communicatively coupled to the main display device, an audio playback device that is integrated within the user device, or an audio playback device that is external yet communicatively coupled to the user device.

16. The apparatus of claim 15, wherein the apparatus comprises one of a set-top box, a small streaming device, a digital video recording (“

DVR”

) device, a processor on the main display device running a software application (“

app”

), a processor on the user device running an app, a server computer over a network, a cloud-based computing system over a network, a media player, or a gaming console.

17. The apparatus of claim 15, wherein the main display device comprises one of a television set, a smart television, a projection system, a computer monitor, or a laptop monitor.

18. The apparatus of claim 15, wherein the user device comprises one of a laptop computer, a tablet computer, a smart phone, a mobile phone, a personal digital assistant, a remote control device, or a portable gaming device.

19. The apparatus of claim 15, wherein the shifting of the display of each of the first video content or the second video content comprises one of a scrolling effect, a sliding effect, a flipping effect, a transitioning effect, or a dragging effect.

20. The apparatus of claim 15, wherein the shifting of the display of each of the first video content or the second video content comprises dynamic cropping of each of the first video content or the second video content such that the first video content and the second video content maintain their display resolution and size while both are being partially displayed during shifting.

21. The apparatus of claim 15, wherein the first video content is video content that is broadcast on a first broadcast channel, while the second video content is video content that is broadcast on a second broadcast channel.

22. The apparatus of claim 15, wherein the first video content and the second video content are video content among a plurality of video content available for browsing or viewing in one of a video on demand (“

VoD”

) platform, a video streaming platform, or a digital video recording (“

DVR”

) platform.

23. The apparatus of claim 15, wherein the first direction is one of a vertical direction with respect to a viewing orientation of the first video content or a horizontal direction with respect to the viewing orientation of the first video content.

24. The apparatus of claim 15, wherein the first video content and the second video content are video content among a plurality of video content that are arranged in a grid pattern with one video content being adjacent to eight video content, wherein the first direction is one of a diagonal direction with respect to a viewing orientation of the first video content, wherein, in response to receiving the user input comprising a swipe in the diagonal direction, portions of the plurality of video content in the grid pattern is shifted along the diagonal direction on one or both of the touchscreen display of the user device or the display screen of the main display device.

25. The apparatus of claim 15, wherein the set of instructions, when executed by the at least one processor, further causes the apparatus to:

receive a second user input via the touchscreen display of the user device, the second user input comprising multiple-finger input indicating one of zoom-in or zoom-out;

in response to receiving the second user input, perform corresponding one of zooming in or zooming out of display of the plurality of video content in the grid pattern on the at least a portion of the touchscreen display; and

mirror the corresponding one of zooming in or zooming out of the display of the plurality of video content in the grid pattern on the at least a portion of the display screen of the main display device.

26. The apparatus of claim 15, wherein the set of instructions, when executed by the at least one processor, further causes the apparatus to:

determine whether the user has selected one of the plurality of video content;

based on a determination that the user has selected one of the plurality of video content, present or continue presenting audio content associated with the selected one of the plurality of video content;

based on a determination that the user has not selected any of the plurality of video content, identify which one of the plurality of video content covers a center position of the at least a portion of the touchscreen display, and present or continue presenting audio content associated with the identified video content that covers the center position of the at least a portion of the touchscreen display;

wherein the audio content is presented using at least one of an audio playback device that is integrated within the main display device, an audio playback device that is external yet communicatively coupled to the main display device, an audio playback device that is integrated within the user device, or an audio playback device that is external yet communicatively coupled to the user device.

27. The apparatus of claim 15, wherein the set of instructions, when executed by the at least one processor, further causes the apparatus to:

display content information associated with each of at least one of the first video content or the second video content on one or both of the display screen of the main display device or the touchscreen display of the user device, wherein the content information is either displayed overlaid over corresponding at least one of the first video content or the second video content or displayed in a separate portion of the one or both of the display screen of the main display device or the touchscreen display of the user device on which neither the first video content nor the second video content are being displayed.

28. A system, comprising:

a computing system, comprising;

at least one first processor; and

a first non-transitory computer readable medium communicatively coupled to the at least one first processor, the first non-transitory computer readable medium having stored thereon computer software comprising a first set of instructions that, when executed by the at least one first processor, causes the computing system to;

send a first video content to a main display device for display of the first video content on the main display device; and

send the first video content to a user device for display of the first video content on the display device, the first video content being displayed on the user device mirroring the first video content being displayed on the main display device;

the main display device, comprising;

a display screen;

at least one second processor; and

a second non-transitory computer readable medium communicatively coupled to the at least one second processor, the second non-transitory computer readable medium having stored thereon computer software comprising a second set of instructions that, when executed by the at least one second processor, causes the main display device to;

receive the first video content from the computing system; and

display the first video content on at least a portion of the display screen of the main display device; and

the user device, comprising;

a touchscreen display;

at least one third processor; and

a third non-transitory computer readable medium communicatively coupled to the at least one third processor, the third non-transitory computer readable medium having stored thereon computer software comprising a third set of instructions that, when executed by the at least one third processor, causes the user device to;

receive the first video content from the computing system;

display the first video content on at least a portion of the touchscreen display of the user device;

receive user input via the touchscreen display of the user device, the user input comprising a first swipe in a first direction relative to a reference point on the touchscreen display of the user device; and

relay the received user input to the computing system;

wherein the first set of instructions, when executed by the at least one first processor, further causes the computing system to;

receive the user input from the user device;

in response to receiving the user input, send display commands to the user device to shift display of the first video content along the first direction on the at least a portion of the touchscreen display while displaying and shifting display of a second video content along the first direction on the at least a portion of the touchscreen display such that the first video content and the second video content are adjacent to each other while display of the first video content and the second video content are being shifted; and

send display commands to the main display device to mirror the display and shifting of the display of the first video content and the second video content on the at least a portion of the display screen of the main display device;

wherein the third set of instructions, when executed by the at least one third processor, further causes the user device to;

in response to receiving display commands from the computing system, shift display of the first video content along the first direction on the at least a portion of the touchscreen display while displaying and shifting display of a second video content along the first direction on the at least a portion of the touchscreen display such that the first video content and the second video content are adjacent to each other while display of the first video content and the second video content are being shifted; and

wherein the second set of instructions, when executed by the at least one second processor, further causes the main display device to;

in response to receiving display commands from the computing system, mirror the display and shifting of the display of the first video content and the second video content on the at least a portion of the display screen of the main display device, wherein the first video content and the second video content continue playback as they are being shifted;

wherein the first set of instructions, when executed by the at least one first processor, further causes the computing system to;

determine whether the second video content fills at least half of the at least a portion of the touchscreen display of the user device;

based on a determination that the second video content fills less than half of the at least a portion of the touchscreen display of the user device, present or continue presenting first audio content associated with the first video content; and

based on a determination that the second video content fills at least half of the at least a portion of the touchscreen display of the user device, present or continue presenting second audio content associated with the second video content;

wherein each of the first audio content or the second audio content is presented using at least one of an audio playback device that is integrated within the main display device, an audio playback device that is external yet communicatively coupled to the main display device, an audio playback device that is integrated within the user device, or an audio playback device that is external yet communicatively coupled to the user device.

29. The system of claim 28, wherein the computing system comprises one of a set-top box, a small streaming device, a digital video recording (“

DVR”

) device, a processor on the main display device running a software application (“

app”

), a processor on the user device running an app, a server computer over a network, a cloud-based computing system over a network, a media player, or a gaming console.

30. The system of claim 28, wherein the main display device comprises one of a television set, a smart television, a projection system, a computer monitor, or a laptop monitor.

31. The system of claim 28, wherein the user device comprises one of a laptop computer, a tablet computer, a smart phone, a mobile phone, a personal digital assistant, a remote control device, or a portable gaming device.