Conference system, server, and computer-readable medium storing conference information generation program

• US 9,960,924 B2
• Filed: 09/30/2013
• Issued: 05/01/2018
• Est. Priority Date: 11/16/2012
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Jiang, Shan, Murase, Yuichi
• Primary Examiner(s): Strange, Aaron
• Application Number:
  US14/041,409
• Publication Number:
  US 20140143345A1
• Time in Patent Office: 1,674 Days
• CPC Class Codes: G06F 11/34 Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status

Abstract

A conference system includes at least one server and at least one mobile terminal connectable to the server. The mobile terminal includes an orientation estimation unit configured to detect orientation information of the mobile terminal, an operation unit configured to detect operation information of an operation performed; and an event transmission unit configured to transmit the orientation information and the operation information. The server includes an image information generation unit configured to generate image information of a conference material and image information of a pointer drawn over the image information of the conference material based on the drawing event, and an action information generation unit configured to generate action information corresponding to the conference material based on drawing history information of the drawn pointer.

Claims

1. A conference system comprising:

a server; and

mobile terminals connectable to the server, wherein each of the mobile terminals includes;

a first memory; and

a first processor connected to the first memory, wherein the first processor

detects orientation information of the mobile terminal;

detects operation information of an operation performed on the mobile terminal by a user; and

transmits, to the server, a drawing event based on the orientation information and the operation information, and

wherein the server includes;

a second memory; and

a second processor connected to the second memory, wherein the second processor

displays each of a plurality of pages of conference material, and changes displayed pages of the conference material in response to a page transition event to display one of the plurality of pages of the conference material in each display time period among a plurality of chronological display time periods;

generates a first image of a pointer drawn over a second image included in each of the plurality of pages of the conference material based on the drawing event;

displays, superimposed the first image of the pointer and the second image of the conference material in the display time period, in which the drawing event occurs, among the plurality of chronological display time periods;

stores drawing events of the pointer which is displayed on each of the plurality of pages of the conference material displayed during each display time period among the plurality of chronological display time periods, in association with the display time period, in a drawing history information database; and

generates a pointer activeness level that indicates a drawing amount of the pointer on each of the displayed pages of the conference material based on the drawing event and the display time periods stored in the drawing history information database,

wherein the drawing amount of the pointer on each of the display pages of the conference material is generated based on a number of the mobile terminals that perform drawing by the pointer on each of the displayed pages during the display time period and a total of the drawing time of the pointer during the display time period.

2. The conference system according to claim 1,

wherein the first processor acquires speech information of the user and generates a sound file,

wherein the first processor further transmits the sound file as a sound event to the server, and

wherein the second processor generates, as action information, at least one of displayed position information of the pointer corresponding to each of the displayed pages, and sound position information indicating a position of the sound file at a time when the pointer is displayed, based on a history of the displayed position information included in the displayed history information of the pointer.

3. The conference system according to claim 2, wherein the second processor generates the pointer activeness level corresponding to each of the displayed pages of the conference material, based on the history of the displayed position information.

4. The conference system according to claim 1, wherein the second processor generates the pointer activeness level corresponding to each of the displayed pages of the conference material, based on a history of displayed position information.

5. The conference system according to claim 1, wherein when a first page of the conference material is displayed before and after a second page of the conference material, the second processor treats the first page displayed before the second page and the first page displayed after the second page as different displayed pages of the conference material in a process of generating the display amount of the pointer on each displayed page of the conference material.

6. The conference system according to claim 1, wherein the second processor generates the pointer activeness level in such a manner that the pointer activeness level rises as the drawing amount of the pointer increases.

7. The conference system according to claim 1, wherein the pointer activeness level is independently generated for each of the mobile terminals.

8. The conference system according to claim 1, wherein the server includes:

a first server that generates the first image information; and

a second server, different from the first server, which generates the displayed history information and the pointer activeness level.

9. The conference system according to claim 1, wherein the drawing event includes a pointer movement event by which movement of the displayed position of the pointer is instructed.

10. The conference system according to claim 1, wherein the drawing event includes an area display control event by which displaying of a size variable area using a displayed position of the pointer as a base point is instructed.

11. A server connectable to a plurality of mobile terminals, the server comprising:

a receiver configured to receive orientation information and operation information of an operation performed by a user, detected by any of the mobile terminals, as a drawing event;

a memory; and

a processor, connected to the receiver and the memory, configured to

display each of a plurality of pages of conference material,

change displayed pages of the conference material in response to a page transition event to display one of the plurality of pages of the conference material in each display time period among a plurality of chronological display time periods;

generate a first image of a pointer drawn over a second image included in each of the plurality of pages of the conference material based on the drawing event;

display superimposed the first image of the pointer and the second image of the conference material in the display time period, in which the drawing event occurs, among the plurality of chronological display time periods;

stores drawing events of the pointer which is displayed on each of the plurality of pages of the conference material displayed during each display time period among the plurality of chronological display time periods, in association with the display time period, in a drawing history information database; and

generate a pointer activeness level that indicates a drawing amount of the pointer on each of the displayed pages of the conference material based on the drawing event and the display time periods stored in the drawing history database,

wherein the drawing amount of the pointer on each of the display pages of the conference material is generated based on a number of the mobile terminals that perform drawing by the pointer on each of the displayed pages during the display time period and a total of the drawing time of the pointer during the display time period.

12. A non-transitory computer-readable medium storing a conference information generation program configured to cause a server, connectable to mobile terminals, to execute conference information generation processing, the conference information generation processing comprising:

receiving orientation information and operation information of an operation performed by a user, detected by any of the mobile terminals, as a drawing event;

displaying each of a plurality of pages of conference material,

changing displayed pages of the conference material in response to a page transition event to display one of the plurality of pages of the conference material in each display time period among a plurality of chronological display time periods;

generating a first image of a pointer drawn over a second image included in each of the plurality of pages of the conference material based on the drawing event;

displaying superimposed the first image of the pointer and the second image of the conference material in the display time period, in which the drawing event occurs, among the plurality of chronological display time periods;

storing drawing events of the pointer which is displayed on each of the plurality of pages of the conference material displayed during each display time period among the plurality of chronological display time periods, in association with the display time period, in a drawing history information database; and

generating a pointer activeness level that indicates a drawing amount of the pointer on each of the displayed pages of the conference material based on the drawing event and the display time periods stored in the drawing history database,

wherein the drawing amount of the pointer on each of the display pages of the conference material is generated based on a number of the mobile terminals that perform drawing by the pointer on each of the displayed pages during the display time period and a total of the drawing time of the pointer during the display time period.