SYSTEM AND METHOD FOR INTERACTIVE SECOND SCREEN

• US 20110289532A1
• Filed: 08/08/2011
• Published: 11/24/2011
• Est. Priority Date: 08/08/2011
• Status: Abandoned Application

• Current Assignee: Lei Yu, Xiaozhi Liu, Yangbin Wang
• Original Assignee: Lei Yu, Xiaozhi Liu, Yangbin Wang
• Inventors: Yu, Lei, Wang, Yangbin, Liu, Xiaozhi
• Application Number:
  US13/204,870
• Publication Number:
  US 20110289532A1
• Time in Patent Office: Days
• US Class Current: 725/38
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]

Abstract

A method and system for interactive second screen comprises the steps of capturing audio, video or image information from the primary screen via sensors built with the secondary screen device; ingesting and collecting VDNA (Video DNA) fingerprints of the captured media information in the secondary screen device; sending the ingested fingerprints along with other information such as metadata, user'"'"'s location, etc, to the content identification server via Internet or mobile networks; providing content-aware information or resources back to the secondary screen device, and providing user interaction with the content-aware information and resources.

Claims

1. A system for interactive second screen, said system comprising:

a) Sub-system capturing audio, video or image information from a primary screen via sensors built with secondary screen device,

b) Sub-system extracting and collecting VDNA (Video DNA) fingerprints of captured media content in said secondary screen device,

c) Sub-system sending said extracted fingerprints along with other information such as metadata, user'"'"'s location, etc to a content and identification server via Internet or mobile networks,

d) Sub-system providing content-aware information or resources back to said secondary screen device, and

e) Sub-system providing user interaction with said content-aware information and resources.

2. The system as recited in claim 1, wherein said second screen is a device used to display additional information of said media content displayed on said primary screen.

3. The system as recited in claim 2, wherein said additional information can be anything relative to said media content such as advertisements, games, contact information, relevant or promoted contents and so on, and such said additional information is controlled by content providers from server side.

4. The system as recited in claim 1, wherein said second screen usually has no physical relationship with said primary screen device.

5. The system as recited in claim 4, wherein said second screen device uses sensors to perceive said media contents that are playing on said primary screen.

6. The system as recited in claim 5, wherein said sensors can be those on said second screen device such as built-in cameras or microphones, or those on other devices connecting to said second screen device to help capturing content from said primary screen.

7. The system as recited in claim 1, wherein said extracting and collecting VDNA fingerprints is performed on said second screen device while capturing content from said primary screen.

8. The system as recited in claim 1, wherein said second screen devices connect with a server through various networks including Internet, GSM/CDMA (global service of mobile communications/code division multiplex access) networks, television networks and so on.

9. The system as recited in claim 1, wherein said identification server and content server can be in a same system providing surrounding information and real-time interactive resources as soon as said content is identified.

10. The system as recited in claim 1, wherein said second screen device can have interaction with said content and identification server or other servers.

11. A method for interactive second screen, said method comprising:

a) capturing audio, video or image information from a primary screen via sensors built with a secondary screen device,

b) extracting and collecting VDNA (Video DNA) fingerprints of captured media content in said secondary screen device,

c) sending said extracted fingerprints along with other information such as metadata, user'"'"'s location, etc to a content and identification server via Internet or mobile networks,

d) providing content-aware information or resources back to said secondary screen device, and

e) providing user interaction with said content-aware information and resources for end users.

12. The method as recited in claim 11, wherein said second screen device may start process automatically by said sensors and keep working continuously, or trigger manually by users.

13. The method as recited in claim 11, wherein said captured media content can be irreversibly extracted to said VDNA fingerprints and sent to said identification server, wherein sending said VDNA fingerprints instead of captured content data has the advantage of greatly saving transmission bandwidth and protecting user privacy.

14. The method as recited in claim 11, wherein said identification server starts identification process as soon as enough said VDNA fingerprints are received from said second screen device.

15. The method as recited in claim 11, wherein content to be played on said second screen may be sent by said identification server as soon as said content is identified, or said content is pulled by said second screen device after receiving result from said identification server.

16. The method as recited in claim 15, wherein said content to play on said second screen is set by content owner or people who has rights to set said content.

17. The method as recited in claim 11, wherein said end users can select preferable type of said content to be displayed on said second screen.

18. The method as recited in claim 11, wherein said sensor can be turned off after working correctly and said end user can determine when to synchronize said second screen with said primary screen.

19. The method as recited in claim 11, wherein said media content can be synchronized between said primary screen and said second screen, and as soon as said content is synchronized, said second screen can turn off said sensor, and said contents on both said screens can play synchronously, and while said content on said primary screen may change at unknown time, said second screen can synchronize with said primary screen at any time as soon as said sensor is available.