Mobile search-ready smart display technology utilizing optimized content fingerprint coding and delivery
First Claim
1. A method for a mobile search-ready smart display system containing a smart display having a screen and at least one mobile device having a camera, the method comprising:
- extracting, by a hardware processor, a plurality of video fingerprints from an ongoing content displayed on the screen, the ongoing content having video frames corresponding to the video fingerprints;
determining, by the hardware processor, one or more representative video fingerprints of the video frames from the plurality of video fingerprints;
generating, by the hardware processor, one or more encoded representative video fingerprints through encoding the one or more representative video fingerprints into a pixel translucency change;
delivering, by the hardware processor, the one or more encoded representative video fingerprints via a screen-camera communication; and
performing, by the hardware processor, the encoding of the one or more representative video fingerprints and the delivering of the one or more encoded representative video fingerprints by solving a polynomial time dynamic problem to find a value indicating a video retrieval accuracy between an error resilience and a transmission time.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for a mobile search-ready smart display system containing a smart display having a screen and at least one mobile device having a camera including extracting a plurality of video fingerprints from an ongoing content displayed on the screen. The ongoing content has video frames corresponding to the video fingerprints; determining one or more representative video fingerprints of the video frames from the plurality of video fingerprints; generating one or more encoded representative video fingerprints through encoding the one or more representative video fingerprints into a pixel translucency change; and delivering the one or more encoded representative video fingerprints via a screen-camera communication. The method also includes optimizing the encoding of the one or more representative video fingerprints and the delivering of the one or more encoded representative video fingerprints to find a balance between an error resilience and transmission time.
3 Citations
20 Claims
-
1. A method for a mobile search-ready smart display system containing a smart display having a screen and at least one mobile device having a camera, the method comprising:
-
extracting, by a hardware processor, a plurality of video fingerprints from an ongoing content displayed on the screen, the ongoing content having video frames corresponding to the video fingerprints; determining, by the hardware processor, one or more representative video fingerprints of the video frames from the plurality of video fingerprints; generating, by the hardware processor, one or more encoded representative video fingerprints through encoding the one or more representative video fingerprints into a pixel translucency change; delivering, by the hardware processor, the one or more encoded representative video fingerprints via a screen-camera communication; and performing, by the hardware processor, the encoding of the one or more representative video fingerprints and the delivering of the one or more encoded representative video fingerprints by solving a polynomial time dynamic problem to find a value indicating a video retrieval accuracy between an error resilience and a transmission time. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A non-transitory computer-readable medium having computer program for, when being executed by a hardware processor, performing a content retrieval method, the method comprising:
-
extracting, by the hardware processor, a plurality of video fingerprints from an ongoing content displayed on the screen, the ongoing content having video frames corresponding to the video fingerprints; determining, by the hardware processor, one or more representative video fingerprints of the video frames from the plurality of video fingerprints; generating, by the hardware processor, one or more encoded representative video fingerprints through encoding the one or more representative video fingerprints into a pixel translucency change; delivering, by the hardware processor, the one or more encoded representative video fingerprints via a screen-camera communication; and performing, by the hardware processor, the encoding of the one or more representative video fingerprints and the delivering of the one or more encoded representative video fingerprints by solving a polynomial time dynamic problem to find a value indicating a video retrieval accuracy between an error resilience and a transmission time. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A method for a mobile device having a camera, comprising:
-
receiving, by a hardware processor, one or more encoded representative video fingerprints of a video frame delivered via a screen-camera communication via a screen-camera communication; decoding, by the hardware processor, the one or more encoded representative video fingerprints to uncoded video fingerprints; searching, by the hardware processor, for a matching video having video frames corresponding to the uncoded video fingerprints in a content database; and returning, by the hardware processor, searching results to a user; wherein; the one or more encoded representative video fingerprints of the video frame are generated by encoding one or more representative video fingerprints of the video frame into a pixel translucency change, the one or more representative video fingerprints are selected from a plurality of video fingerprints extracted from an ongoing content displayed on a screen of a smart display, the encoding of the representative fingerprints and the delivering of the encoded representative video fingerprints are performed by solving a polynomial time dynamic problem to find a value indicating a video retrieval accuracy between an error resilience and a transmission time. - View Dependent Claims (18, 19, 20)
-
Specification