Methods and devices for providing companion services to video

• US 9,648,268 B2
• Filed: 09/30/2014
• Issued: 05/09/2017
• Est. Priority Date: 06/01/2012
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Adams, Neil Patrick
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): NEWLIN, TIMOTHY R
• Application Number:
  US14/501,809
• Publication Number:
  US 20150015788A1
• Time in Patent Office: 952 Days
• CPC Class Codes: G06F 40/12 Use of codes for handling textual entities
• CPC Class Codes: H04N 21/234 Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4333 Processing operations in response to a pause request
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application

Abstract

Methods and devices for providing companion services to video are described. In one example embodiment, the method includes: identifying text contained within a video; determining, by performing pattern matching, if the identified text in the video contains actionable text; and if the identified text in the video contains actionable text, providing access to one or more features based on the actionable text.

Claims

1. A method performed by a processor of providing companion services to a companion device associated with a media display device, the method comprising:

detecting video being displayed on the media display device;

in response to detecting video being displayed, automatically identifying text contained within the video;

determining, by performing pattern matching, if the identified text in the video contains one or more actionable text;

if the identified text in the video contains one or more actionable text, providing access to one or more features at the companion device based on the one or more actionable text while playback of the video is being provided on the media display device,

wherein providing access to the one or more features includes adding an actionable link to an actionable object list, and wherein the added actionable link is associated with the identified one or more actionable text, and wherein the added actionable link is a link to an operation,

and wherein when the actionable object list contains two or more actionable links, each actionable link in the actionable object list is a link to a unique operation, and wherein the actionable object list is a running list of added actionable links that includes actionable links associated with previously identified one or more actionable text; and

providing instructions to display at the companion device the added actionable links in the actionable object list based on an order in which the one or more actionable text associated with the added actionable links were identified in the video.

2. The method of claim 1, wherein providing access to one or more features comprises:

providing an actionable link to create a calendar event based on the one or more actionable text.

3. The method of claim 2, wherein the calendar event comprises a reminder, a meeting or an alarm.

4. The method of claim 2, wherein the calendar event comprises a meeting request.

5. The method of claim 2, wherein the calendar event comprises an alarm.

6. The method of claim 1, further comprising:

determining that playback of the video has been paused, and wherein identifying text contained within a video comprises;

identifying text contained within a frame of the video displayed while the playback of the video has been paused.

7. The method of claim 1, wherein determining if the identified text in the video contains one or more actionable text comprises:

determining if the identified text in the video contains a string of characters having one or more predetermined formats.

8. The method of claim 1, wherein identifying text contained in the video comprises:

analyzing one or more frames of the video to identify text contained in the video.

9. The method of claim 1, wherein identifying text contained in the video comprises:

intermittently analyzing frames of the video.

10. The method of claim 1, wherein providing access to one or more features comprises automatically performing a function associated with the one or more actionable text on the companion device.

11. The method of claim 1, further comprising:

receiving a favorite indicator corresponding to a selected actionable link in the actionable object list and associating the favorite indicator to the selected actionable link; and

persistently displaying the selected actionable link associated with the favorite indicator at the start of the actionable object list.

12. The method of claim 1, further comprising:

detecting selection of an actionable link in the actionable object list; and

resuming playback of the video at a point in time where the one or more actionable text associated with the selected actionable link was determined.

13. An electronic device comprising:

a memory; and

a processor coupled to the memory, the processor being configured to;

detect video being displayed on the media display device;

in response to detecting video being displayed, automatically identify text contained within the video;

determine, by performing pattern matching, if the identified text in the video contains one or more actionable text;

if the identified text in the video contains one or more actionable text, provide access to one or more features based on the one or more actionable text while playback of the video is being provided on the media display device,

wherein providing access to the one or more features includes adding an actionable link to an actionable object list, and wherein the added actionable link is associated with the identified one or more actionable text, and wherein the added actionable link is a link to an operation,

and wherein when the actionable object list contains two or more actionable links, each actionable link in the actionable object list is a link to a unique operation, and wherein the actionable object list is a running list of added actionable links that includes actionable links associated with previously identified one or more actionable text; and

provide instructions to display at the companion device the added actionable links in the actionable object list based on an order in which the one or more actionable text associated with the added actionable links were identified in the video.

14. The electronic device of claim 13 further comprising:

a display coupled to the processor for displaying the video;

a short range communications subsystem coupled to the processor for sending a command to a companion device to instruct the companion device to provide the access to one or more features based on the one or more actionable text.

15. The electronic device of claim 13, further comprising:

a short range communication subsystem coupled to the processor for providing the video to the media display device for playback on the media display device, and wherein the one or more features are provided on the electronic device.

16. A method performed by a processor of providing companion services to a companion device associated with a media display device, the method comprising:

detect video being displayed on the media display device;

in response to detecting video being displayed, automatically determining if the video includes an actionable object associated with a product;

if the video includes the actionable object associated with the product, performing product-recognition to identify the product represented in the video;

providing, at the companion device, access to one or more companion features based on the identified product while playback of the video is being provided on the media display device, wherein providing access to one or more companion features includes adding a referrer identifier to a referrer object list, and wherein the referrer identifier is a link to a website address to associate access of the website address with a referrer, and wherein the referrer object list is a running list of added referrer identifiers that includes referrer identifiers associated with previously identified actionable objects associated with products; and

providing instructions to display the added referrer identifiers in the referrer object list based on an order in which the actionable objects associated with the added referrer identifiers were identified in the video.

17. The method of claim 16, wherein providing access to the one or more companion features based on the identified product further comprises:

providing access to the website address; and

providing a selectable option to purchase the product.

18. The method of claim 16, wherein providing access to the one or more companion features based on the identified product further comprises:

tracking a number of accesses to the website address associated with the referrer identifier to provide compensation to the referrer.