Processing techniques in audio-visual streaming systems

• US 10,070,183 B2
• Filed: 12/15/2015
• Issued: 09/04/2018
• Est. Priority Date: 12/15/2014
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Digital Media Services Inc. (Verizon Communications Inc.)
• Inventors: Kilar, Jason A., Tom, Richard W., Lee, Lonn, Lei, Bao, Cai, Jiwen, Zhou, Yanqing, Lui, Jocelyn
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): Riaz, Sahar Aqil
• Application Number:
  US14/970,523
• Publication Number:
  US 20160173944A1
• Time in Patent Office: 994 Days
• Field of Search: 725 40, 725 44
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: H04B 1/3827 Portable transceivers
• CPC Class Codes: H04H 60/32 Arrangements for monitoring conditions of receiving stations, e.g. malfunction or breakdown of receiving stations
• CPC Class Codes: H04H 60/33 Arrangements for monitoring the users' behaviour or opinions
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/234345 the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4516 : involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
• CPC Class Codes: H04N 21/458 : Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/4622 : Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/472 : End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6582 : Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments

Abstract

Techniques are disclosed that generally relate to content delivery techniques in audio-visual systems. In an audio-visual system, a method of using sensors to incrementally present content elements on a display includes presenting a first content element on the display, receiving first data from a sensor, the first data associated with a first distance. An increment coefficient is identified, and a portion size is determined by reducing the first distance by the increment coefficient. Finally, an unseen portion of a second content element is incrementally added to the display, and a presented portion of the first content element is incrementally removed from the display, the size of the portions added and removed being equal to the determined portion size.

Claims

1. A method of using sensors to present content elements on a display of a computing device, the method comprising, by the computing device:

presenting a first content element on the display;

identifying a target display time in response to said presenting of the first content element, said target display time comprising a minimum of number of seconds for retaining said presenting of the first content element on the display, wherein said minimum number of seconds is greater than two seconds;

identifying a gesture count based on the target display time, wherein the gesture count is a number of times a particular gesture is performed to remove the first content element from said display before or by the target display time, and wherein the number of times the particular gesture is performed is at least two;

receiving data from a sensor, the data comprising a plurality of gestures detected by said sensor;

retaining the first content element on the display in response to receiving the data from the sensor before said target display time is reached and the data comprising fewer gestures than the gesture count, wherein said retaining comprises incrementing a counter with each gesture of the plurality of gestures during said receiving; and

replacing the first content element on the display with a second content element on the display in response to the counter equaling or exceeding the gesture count.

2. The method of claim 1, further comprising:

dynamically determining, during the incrementing of the counter, a fraction of the gesture count that is represented by the counter; and

displaying a visual indicator on the display, the visual indicator being based on the determined fraction, wherein the visual indicator is changed based on changes to the determined fraction.

3. The method of claim 1, further comprising:

configuring a first distance by which a gesture offsets a position of a content element in said display; and

identifying an increment coefficient for the first content element based on the gesture count, said increment coefficient reducing said first distance to a lesser second distance, wherein said retaining comprises adjusting in response to each gesture of the plurality of gestures, said position of the first content element by the second distance of the increment coefficient.

4. The method of claim 3, further comprising:

changing the increment coefficient from a first value to a second value while incrementing the counter.

5. The method of claim 4, further comprising:

detecting a first amount of force or a greater second amount of force with which a gesture is applied,

wherein changing the increment coefficient from the first value to the second value is based on said detecting.

6. The method of claim 4, further comprising:

detecting velocity based on a start time and an end time of a gesture,

wherein changing the increment coefficient from the first value to the second value is based on said detecting.

7. A device comprising:

a display;

a sensor;

a non-transitory computer-readable medium storing a set of processor-executable instructions; and

one or more processors configured to execute the set of processor-executable instructions, wherein executing the set of processor-executable instructions causes the one or more processors to;

present a first content element on the display;

identify a target display time in response to said presenting of the first content element, said target display time comprising a minimum of number of seconds for retaining said presenting of the first content element on the display, wherein said minimum number of seconds is greater than two seconds;

identify a gesture count based on the target display time, wherein the gesture count is a number of times a particular gesture is performed to remove the first content element from said display before or by the target display time, and wherein the number of times the particular gesture is performed is at least two;

receive data from the sensor, the data comprising a plurality of gestures detected by said sensor;

retain the first content element on the display in response to receiving the data from the sensor before said target display time is reached and the data comprising fewer gestures than the gesture count, wherein said retaining comprises incrementing a counter with each gesture of the plurality of gestures during said receiving; and

replace the first content element on the display with a second content element on the display in response to the counter equaling or exceeding the gesture count.

8. The device of claim 7, wherein the processor-executable instructions further include processor-executable instructions to:

dynamically determine, during the incrementing of the counter, a fraction of the gesture count that is represented by the counter; and

display a visual indicator on the display, the visual indicator being based on the determined fraction, wherein the visual indicator is changed based on changes to the determined fraction.

9. The device of claim 7, wherein the processor-executable instructions further include processor-executable instructions to:

configure a first distance by which a gesture offsets a position of a content element in said display; and

identify an increment coefficient for the first content element based on the gesture count, said increment coefficient reducing said first distance to a lesser second distance, wherein said retaining comprises adjusting in response to each gesture of the plurality of gestures, said position of the first content element by the second distance of the increment coefficient.

10. The device of claim 9, wherein the processor-executable instructions further include processor-executable instructions to:

change the increment coefficient from a first value to a second value while incrementing the counter.

11. The device of claim 10, wherein the processor-executable instructions further include processor-executable instructions to:

detect a first amount of force or a greater second amount of force with which a gesture is applied,

wherein changing the increment coefficient from the first value to the second value is based on said detecting.

12. The device of claim 10, wherein the processor-executable instructions further include processor-executable instructions to:

detect velocity based on a start time and an end time of a gesture,

wherein changing the increment coefficient from the first value to the second value is based on said detecting.

13. A non-transitory computer-readable medium, storing a set of processor-executable instructions, which, when executed by one or more processors of a device, cause the one or more processors to:

present a first content element on a display;

identify a target display time in response to said presenting of the first content element, said target display time comprising a minimum of number of seconds for retaining said presenting of the first content element on the display, wherein said minimum number of seconds is greater than two seconds;

identify a gesture count based on the target display time, wherein the gesture count is a number of times a particular gesture is performed to remove the first content element from said display before or by the target display time, and wherein the number of times the particular gesture is performed is at least two;

receive data from a sensor, the data comprising a plurality of gestures detected by said sensor;

retain the first content element on the display in response to receiving the data from the sensor before said target display time is reached and the data comprising fewer gestures than the gesture count, wherein said retaining comprises incrementing a counter with each gesture of the plurality of gestures during said receiving; and

replace the first content element on the display with a second content element on the display in response to the counter equaling or exceeding the gesture count.

14. The non-transitory computer-readable medium of claim 13, wherein the processor-executable instructions include processor-executable instructions to:

dynamically determine, during the incrementing of the counter, a fraction of the gesture count that is represented by the counter; and

display a visual indicator on the display, the visual indicator being based on the determined fraction, wherein the visual indicator is changed based on changes to the determined fraction.

15. The non-transitory computer-readable medium of claim 13, wherein the processor-executable instructions include processor-executable instructions to:

configure a first distance by which a gesture offsets a position of a content element in said display; and

identify an increment coefficient for the first content element based on the gesture count, said increment coefficient reducing said first distance to a lesser second distance, wherein said retaining comprises adjusting in response to each gesture of the plurality of gestures, said position of the first content element by the second distance of the increment coefficient.

16. The non-transitory computer-readable medium of claim 15, wherein the processor-executable instructions include processor-executable instructions to:

change the increment coefficient from a first value to a second value while incrementing the counter.

17. The non-transitory computer-readable medium of claim 16, wherein the processor-executable instructions include processor-executable instructions to:

detect a first amount of force or a greater second amount of force with which a gesture is applied,

wherein changing the increment coefficient from the first value to the second value is based on said detecting.

18. The non-transitory computer-readable medium of claim 16, wherein the processor-executable instructions include processor-executable instructions to:

detect velocity based on a start time and an end time of a gesture,

wherein changing the increment coefficient from the first value to the second value is based on said detecting.