Interaction method based on multimedia programs and terminal device

• US 10,390,108 B2
• Filed: 07/25/2016
• Issued: 08/20/2019
• Est. Priority Date: 06/13/2014
• Status: Active Grant

• Current Assignee: Tencent Technology Shenzhen Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Shenzhen Company Limited (Tencent Holdings Limited)
• Inventors: Ye, Wa, Wang, Hongyang, Hou, Jie, Xu, Zhenyu, Tang, Zhuo, Wang, Rui, Li, Keren, Sun, Bo, Zang, Jing
• Primary Examiner(s): Chae, Kyu
• Application Number:
  US15/219,102
• Publication Number:
  US 20160337717A1
• Time in Patent Office: 1,121 Days
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4758 for providing answers, e.g. voting
• CPC Class Codes: H04N 21/4784 receiving rewards
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/8545 for generating interactive applications

Abstract

An interaction method based on multimedia programs, a terminal device, a server and a system are disclosed, which belong to the field of network technologies. The method includes: acquiring at least one image clip information of a multimedia program in a process of playing back the multimedia program; sending the image clip information, the image clip information being used for matching corresponding multimedia program information; receiving interaction information corresponding to the multimedia program information; and outputting an interactive interface, to interact with the multimedia program based on an interaction operation on the interactive interface. The present disclosure is easy to operate, and improves interaction efficiency.

Claims

1. An interaction method based on multimedia programs, running in a terminal device, the terminal device comprising a memory and one or more processors, and a program instruction being stored in the memory and executed by the one or more processors, the method comprising:

acquiring at least one image clip information of a multimedia program from a playback device in a process of playing back the multimedia program by the playback device adjacent to the terminal device;

sending the image clip information to a remote server, the image clip information being used by the remote server for matching corresponding multimedia program information and used by the remote server for indicating an interaction form;

receiving, from the remote server, interaction information corresponding to the multimedia program information and the interaction form, wherein the interaction information includes a first user ID of an instant messaging (IM) application and an instruction of invoking the IM application; and

outputting, according to the interaction information, an interactive interface at least comprising the interaction form, to interact with the multimedia program based on the interaction form, the interaction form referring to a type of information sent and received by the terminal device based on an interaction operation on the interactive interface, further comprising;

judging whether a user relation chain of a second user ID of the IM application associated with the terminal device comprises the first user ID;

when the user relation chain of the second user ID comprises the first user ID, including, in the interactive interface, at least an IM session window of the second user ID and the first user ID, receiving IM messages input in the IM session window by a user of the terminal device, and transmitting the IM messages based on the second user ID to a second terminal device associated with the first user ID; and

when the user relation chain of the second user ID does not comprise the first user ID, including, in the interactive interface, an informational session window of the first user ID and an attention button of the first user ID, and wherein an attention request is sent to the second terminal device associated with the first user ID in response to a user selection of the connection button and the first user ID is added to the user relation chain of the second user ID after the attention request is accepted by the second terminal device.

2. The method according to claim 1, wherein the acquiring at least one image clip information of a multimedia program comprises:

scanning a display screen of the playback device where the multimedia program is played, to obtain the at least one image clip information of the multimedia program.

3. The method according to claim 1, wherein the outputting, according to the interaction information, an interactive interface, to interact with the multimedia program based on the interaction form comprises:

when the interaction information comprises multiple candidate options, outputting an interactive interface in the IM session window at least comprising the multiple candidate options, and when a selection operation on a specified candidate option in the interactive interface is detected, sending the specified candidate option.

4. The method according to claim 1, wherein the outputting, according to the interaction information, an interactive interface, to interact with the multimedia program based on the interaction form comprises:

when the interaction information comprises prompt information, outputting an interactive interface in the IM session window at least comprising the prompt information and an input field, acquiring response information input in the input field, and sending the response information.

5. The method according to claim 1, wherein the outputting, according to the interaction information, to interact with the multimedia program based on the interaction form comprises:

when the interaction information comprises lottery information, outputting an interactive interface in the IM session window at least comprising the lottery information, receiving a lottery result, and displaying the lottery result in the lottery interface.

6. The method according to claim 1, wherein the outputting, according to the interaction information, to interact with the multimedia program based on the interaction form comprises:

when the interaction information comprises a target value, outputting a target display interface in the IM session window at least comprising the target value and an exchange option, if a click operation on the exchange option is detected, outputting a value transfer interface at least comprising the target value and a value transfer option, and if a click operation on the value transfer option is detected, sending a value transfer request for the target;

or

when the interaction information comprises a target value, outputting a value transfer interface in the IM session window at least comprising the target value and a value transfer option, and if a click operation on the value transfer option is detected, sending a value transfer request for the target.

7. The method according to claim 1, wherein the outputting, according to the interaction information, to interact with the multimedia program based on the interaction form comprises:

when the interaction information is multimedia program information, outputting an interactive interface in the IM session window at least comprising the multimedia program information, the interactive interface being configured to display the multimedia program information.

8. A terminal device, comprising:

a memory configured to store instructions; and

one or more processors;

wherein the one or more processors execute the instructions to;

acquire at least one image clip information of a multimedia program from a playback device in a process of playing back the multimedia program by the playback device adjacent to the terminal device;

send the image clip information to a remote server, the image clip information being used by the remote server for matching corresponding multimedia program information and used by the remote server for indicating an interaction form;

receive, from the remote server, interaction information corresponding to the multimedia program information and the interaction form, wherein the interaction information includes a first user ID of an instant messaging (IM) application and an instruction of invoking the IM application; and

output, according to the interaction information, an interactive interface at least comprising the interaction form, to interact with the multimedia program based on the interaction form, the interaction form referring to a type of information sent and received by the terminal device based on an interaction operation on the interactive interface, further comprising;

judging whether a user relation chain of a second user ID of the IM application associated with the terminal device comprises the first user ID;

when the user relation chain of the second user ID comprises the first user ID, including, in the interactive interface, at least an IM session window of the second user ID and the first user ID, receiving IM messages input in the IM session window by a user of the terminal device, and transmitting the IM messages based on the second user ID to a second terminal device associated with the first user ID, and

when the user relation chain of the second user ID does not comprise the first user ID, including, in the interactive interface, an informational session window of the first user ID and an attention button of the first user ID, and wherein an attention request is sent to the second terminal device associated with the first user ID in response to a user selection of the connection button and the first user ID is added to the user relation chain of the second user ID after the attention request is accepted by the second terminal device.

9. The terminal device according to claim 8, wherein the one or more processors execute the instructions further

to scan a display screen of the playback device where the multimedia program is played, to obtain the at least one image clip information of the multimedia program.

10. The terminal device according to claim 8, wherein the one or more processors execute the instructions further

to, when the interaction information comprises multiple candidate options, output an interactive interface in the IM session window at least comprising the multiple candidate options, and when a selection operation on a specified candidate option in the interactive interface is detected, send the specified candidate option.

11. The terminal device according to claim 8, wherein the one or more processors execute the instructions further

to, when the interaction information comprises prompt information, output an interactive interface in the IM session window at least comprising the prompt information and an input field, acquire response information input in the input field, and send the response information.

12. The terminal device according to claim 8, wherein the one or more processors execute the instructions further

to, when the interaction information comprises lottery information, output an interactive interface in the IM session window at least comprising the lottery information, receive a lottery result, and display the lottery result in the lottery interface.

13. The terminal device according to claim 8, wherein the one or more processors execute the instructions further to,

when the interaction information comprises a target value, output a target display interface in the IM session window at least comprising the target value and an exchange option, if a click operation on the exchange option is detected, output a value transfer interface at least comprising the target value and a value transfer option, and if a click operation on the value transfer option is detected, send a value transfer request for the target;

or

when the interaction information comprises a target value, output a value transfer interface in the IM session window at least comprising the target value and a value transfer option, and if a click operation on the value transfer option is detected, send a value transfer request for the target.

14. The terminal device according to claim 8, wherein the one or more processors execute the instructions further

to, when the interaction information is multimedia program information, output an interactive interface in the IM session window at least comprising the multimedia program information, the interactive interface being configured to display the multimedia program information.

15. An improved system for facilitating interactive use of a multimedia program, comprising:

a server having a memory, one or more processors, and a stored program instruction that can be executed by said one or more processors, wherein;

said server is capable of storing and transmitting at least one multimedia program and associated multimedia-program information;

a playback device in communication with said server, said playback device capable of playing a multimedia program;

a terminal device having a memory, one or more processors, a digital camera, and a stored program instruction that can be executed by said one or more processors, wherein said program instruction, when executed, comprises the program steps of;

acquiring via said digital camera at least one image-clip information of a multimedia program from said playback device in a process of playing back the multimedia program on said playback device adjacent to the terminal device, as initiated by a user of said terminal device,

transmitting said image-clip information to said server, wherein said image-clip information can be used for matching corresponding multimedia-program information stored on said server and used for indicating a user-interaction form,

receiving, from said server, user-interaction information corresponding to said multimedia-program information and said user-interaction form, wherein the user-interaction information includes a first user ID of an instant messaging (IM) application and an instruction of invoking the IM application; and

outputting, to said playback device, the user-interaction information and a user-interactive interface that comprises at least said user-interaction form for interacting with said multimedia program based on said user-interaction form, said user-interaction form referring to a type of information sent and received by said terminal device based on an interaction operation on the user-interactive interface, wherein said playback device is configured to;

judge whether a user relation chain of a second user ID of the IM application associated with the terminal device comprises the first user ID;

when the user relation chain of the second user ID comprises the first user ID, include, in the user-interactive interface, at least an IM session window of the second user ID and the first user ID, receive IM messages input in the IM session window by a user of said terminal device, and transmit the IM messages based on the second user ID to a second terminal device associated with the first user ID; and

when the user relation chain of the second user ID does not comprise the first user ID, include, in the user-interactive interface, an informational session window of the first user ID and an attention button of the first user ID, and an attention request is sent to the second terminal device associated with the first user ID in response to a user selection of the connection button and the first user ID is added to the user relation chain of the second user ID after the attention request is accepted by the second terminal device.

16. The system of claim 15, wherein said terminal'"'"'s digital camera acquires said at least one image-clip information from said playback device by scanning a display screen on said playback device that is playing said multimedia program in order to obtain said at least one image clip information of a multimedia program.

17. The system of claim 15, wherein said outputted user-interactive interface to said playback device further comprises multiple candidate options, wherein when a selection operation on a specified candidate option in the interactive interface is detected by said terminal device, the user-selected candidate option is transmitted to said server.

18. The system of claim 15, wherein said outputted user-interactive interface to said playback device further comprises user-prompt information and an associated input field for acquiring user-response information in the input field by said terminal device and transmitting said user-response information to said server.

19. The system of claim 15, wherein said outputted user-interactive interface to said playback device further comprises lottery information, including the ability to receive and display a lottery result on said playback device.

20. The system of claim 15, wherein:

said outputted user-interactive interface to said playback device further comprises a target value and an exchange option;

if a user-click operation on said exchange option is detected by said terminal device, then a value-transfer interface that is comprised of said target value and a value-transfer option is outputted from said terminal device to said playback device; and

if a user-click operation on said value-transfer option is detected by said terminal device, then a value-transfer request for the target is transmitted from said playback device to said server.

21. The system of claim 15, wherein:

said outputted user-interactive interface to said playback device further comprises a target value, and a value-transfer interface at least comprising said target value and a value-transfer option are outputted from said terminal device to said playback device, and

if a user-click operation on the value-transfer option is detected, then a value-transfer request for the target is transmitted from said playback device to said server.

22. The system of claim 15, wherein when said user-interaction information is multimedia-program information, then a user-interactive interface at least comprising said multimedia-program information is outputted from said terminal device to said playback device, the interactive interface being configured to display the multimedia-program information.

23. The system of claim 15, wherein said playback device is the same as said terminal device.