System and method for providing image-based video service

• US 10,455,256 B2
• Filed: 02/29/2016
• Issued: 10/22/2019
• Est. Priority Date: 05/03/2012
• Status: Active Grant

• Current Assignee: Enswers Incorporated (RR Donnelley & Sons Company)
• Original Assignee: Enswers Incorporated (RR Donnelley & Sons Company)
• Inventors: Kim, Kil-youn, Lee, Jaehyung, Cho, Hoon-young
• Primary Examiner(s): Flynn, Nathan J
• Assistant Examiner(s): Somera, Caroline
• Application Number:
  US15/057,008
• Publication Number:
  US 20160255380A1
• Time in Patent Office: 1,331 Days
• Field of Search: 725 1, 725 86
• CPC Class Codes: G06Q 20/123 Shopping for digital content
• CPC Class Codes: G06Q 50/10 Services
• CPC Class Codes: H04N 21/2183 Cache memory caches in web servers or browsers G06F16/9574; intermediate storage and caching in data networks H04L67/568
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/254 Management at additional data server, e.g. shopping server, rights management server arrangements for maintenance or administration in data networks H04L41/00; network services using third party service providers H04L67/53
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467

Abstract

The present invention provides a system for providing image-based video service, including a cache system configured to store video information that matches image-related data; a fingerprint extraction unit configured to extract the fingerprint of an image corresponding to input image-related data; and a matching unit configured to determine video information that matches the fingerprint of the image extracted by the fingerprint extraction unit; wherein the system for providing image-based video service determines video information, matching image-related data received from a client terminal, via the cache system or the matching unit, and transmits video result information corresponding to the determined video information to the client terminal, and a method using the same.

Claims

1. A server, comprising:

a cache system, comprising a cache table that stores first video information, the first video information including an expiration time for the first video information;

wherein the server is configured for;

receiving image-related data comprising a network location for retrieving an image and an expiration time for the image, the expiration time indicating a duration that the image is valid at the network location;

determining whether the first video information stored in the cache table matches the received image-related data based on the network location and the expiration time by at least determining whether the stored expiration time for the first video information matches the received expiration time for the image; and

after determining that the first video information does not match the image-related data;

extracting a fingerprint of the image corresponding to the received image-related data, wherein the extracting comprises;

(i) segmenting the acquired image data into one or more pieces of segmented image data, and (ii) extracting a fingerprint for at least one piece of the one or more pieces of segmented image data,

determining second video information that matches the extracted fingerprint of the image, and

transmitting the second video information.

2. The server of claim 1, wherein the server is further configured for:

after determining that the first video information does match the image-related data, transmitting the first video information.

3. The server of claim 1, wherein determining whether the first video information stored in the cache table matches the received image-related data further comprises determining the first video information using the cache table based on the received network location.

4. The server of claim 1, wherein the first video information comprises a video identifier (ID) identifying a video, and a frame ID identifying a frame of the video.

5. The server of claim 1, wherein extracting the fingerprint of an image corresponding to the received image-related data comprises:

acquiring image data corresponding to the image-related data, and

extracting an extracted fingerprint for the acquired image data.

6. The server of claim 5, wherein determining second video information that matches the extracted fingerprint of the image comprises:

determining the second video information that matches the extracted fingerprint by at least matching the extracted fingerprint with one or more fingerprints stored in a fingerprint database.

7. The server of claim 5, wherein the server is further configured for:

transmitting the second video information to the cache system, and

storing the second video information in the cache table using the cache system, wherein the second video information comprises a video ID and a frame ID matching the extracted fingerprint.

8. The server of claim 1, wherein the server is further configured for:

identifying one or more pieces of the second video information; and

determining that the acquired image data matches the second video information by at least matching at least one piece of the one or more pieces of segmented image data with at least one piece of the one or more pieces of the second video information.

9. The server of claim 8, wherein identifying the one or more pieces of the second video information comprises identifying video information corresponding to most frequent video and frame IDs of video and frame IDs included in the one or more pieces of the second video information.

10. The server of claim 8, wherein the server is further configured for storing the one or more pieces of the second video information in the cache table.

11. The server of claim 1, wherein the cache table is updated at regular intervals based on a hash value of image data.

12. The server of claim 1, wherein the second video information comprises a network location for retrieving video data associated with the second video information.

13. A method, comprising:

receiving image-related data at a server, wherein the image-related data comprises a network location for retrieving an image and an expiration time for the image, the expiration time indicating a duration that the image is valid at the network location, wherein first video information is stored in a cache table of the server, and wherein the first video information includes an expiration time for the first video information;

determining, using the server, whether the first video information matches the received image-related data based on the network location and the expiration time by at determining whether the stored expiration time for the first video information matches the received expiration time for the image; and

after determining that the first video information does not match the image-related data, the server;

extracting a fingerprint of the image corresponding to the received image-related data, wherein the extracting comprises;

(i) segmenting the acquired image data into one or more pieces of segmented image data, and (ii) extracting a fingerprint for at least one piece of the one or more pieces of segmented image data,

determining second video information that matches the extracted fingerprint of the image, and

transmitting the second video information.

14. The method of claim 13, further comprising:

after determining that the first video information does match the image-related data, the server transmitting the first video information.

15. The method of claim 13,

wherein determining whether the first video information stored in the cache table matches the received image-related data further comprises determining the first video information using the cache table based on the received network location.

16. The method of claim 13, wherein the first video information comprises a video identifier (ID) identifying a video, and a frame ID identifying a frame of the video.

17. The method of claim 13, wherein extracting the fingerprint of an image corresponding to the received image-related data comprises:

acquiring image data corresponding to the image-related data, and

extracting an extracted fingerprint for the acquired image data.

18. The method of claim 13, wherein the cache table is updated at regular intervals based on a hash value of image data.

19. The method of claim 13, wherein the second video information comprises a network location for retrieving video data associated with the second video information.