Information processing system that organizes and clearly presents mass data to user, information processing methods, and recording medium

• US 10,061,485 B2
• Filed: 07/06/2015
• Issued: 08/28/2018
• Est. Priority Date: 07/08/2014
• Status: Active Grant

• Current Assignee: KYOCERA Document Solutions, Inc. (Kyocera Corporation)
• Original Assignee: KYOCERA Document Solutions, Inc. (Kyocera Corporation)
• Inventors: Ikejima, Ayaka, Yuki, Akira, Endo, Wataru, Tanba, Masato
• Primary Examiner(s): Lewis, Cheryl
• Application Number:
  US14/792,078
• Publication Number:
  US 20160012154A1
• Time in Patent Office: 1,149 Days
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs

Abstract

An information processing system includes an information processing device, a display apparatus, and an operation detecting device. The control circuit allocates (N−1) or more mutually different attributes to respective axes of a (N−1)-dimensional space, generates a graph plotting the plurality pieces of stored data on the (N−1)-dimensional space as respective points corresponding to the plurality pieces of data, classifies the plurality pieces of plotted data into groups using another one attribute other than the (N−1) or more attributes; and processes the plurality of points so as to be identified by the group. The display apparatus displays the graph processed by the control circuit. The operation detecting device detects an action performed by a user. The control circuit moves, rotates, zooms in, and zooms out the graph displayed on the display apparatus depending on the user'"'"'s action detected by the operation detecting device.

Claims

1. An information processing system, comprising:

an information processing device;

a display apparatus; and

an operation detecting device,

wherein the information processing device includes a storage circuit that stores a plurality of pieces of data having four types of attributes indicating a subject of an e-mail, time of sending and receiving of the e-mail, frequency of sending and receiving of the e-mail, and a count of e-mail recipients, and a control circuit,

wherein the control circuit that;

allocates the time of sending and receiving of the e-mail, the frequency of sending and receiving of the e-mail, and the count of e-mail recipients as three mutually different attributes to respective axes of a three-dimensional space;

generates a graph plotting the plurality pieces of stored data of the e-mail on the three-dimensional space as respective points corresponding to the plurality pieces of data;

classifies the plurality pieces of plotted data into groups using an attribute indicating the subject of the e-mail of the four types of attributes; and

processes the plurality of points so as to be identified by the group by generating a line having the point representing data included in the group, wherein the processing includes linking the plotted data with the curved line per-thread based on the subject of the e-mail to represent the stream,

wherein the display apparatus displays the graph processed by the control circuit,

the operation detecting device detects an action performed by a user by detecting an absolute position of the user'"'"'s hand and finger in the three-dimensional space,

the control circuit moves, rotates, zooms in, and zooms out the graph displayed on the display apparatus depending on the user'"'"'s action detected by the operation detecting device, and

the control circuit displays, on the display apparatus, contents of the data adjacent to a part that the user is attempting to pinch, as preview images in the positions corresponding to the respective data.

2. The information processing system according to claim 1,

wherein the display apparatus causes the user visually and stereoscopically to recognize the graph overlapped with his or her hand and finger,

the control circuit communicates with the user by a Natural User Interface for the user having a sense of operation by directly touching the stereoscopically displayed graph.

3. The information processing system according to claim 1,

wherein the control circuit selects the line of a user'"'"'s operation target by the user'"'"'s making action of waving his or her hand to the axis direction detected by the operation detecting device.

4. The information processing system according to claim 1,

wherein the control circuit selects data on the line corresponding to the part pinched by the user by the user'"'"'s making action of pinching the line detected by the operation detecting device.

5. The information processing system according to claim 1,

wherein the control circuit displays content of data adjacent to a part pinched by the user on the line, the data corresponding to the part pinched by the user by the user'"'"'s making action of pinching the line detected by the operation detecting device.

6. The information processing system according to claim 1,

wherein the plurality pieces of data include the e-mail,

the three different attributes include time of sending and receiving the e-mail, frequency of sending and receiving the e-mail per unit time, and a recipient of the e-mail, and

the other one attribute is a title of the e-mail.

7. An information processing method using an information processing device that includes a storage circuit that stores a plurality of pieces of data having four types of attributes indicating a subject of an e-mail, time of sending and receiving of the e-mail, frequency of sending and receiving of the e-mail, and a count of e-mail recipients, the method comprising:

allocating the time of sending and receiving of the e-mail, the frequency of sending and receiving of the e-mail, and the count of e-mail recipients as three mutually different attributes of four types of attributes stored in the storage circuit, to respective axes of a three-dimensional space;

generating a graph plotting the plurality pieces of stored data of the e-mail on the three-dimensional space as respective points corresponding to the plurality pieces of data;

classifying the plurality pieces of plotted data into groups using an attribute indicating the subject of the e-mail of the four types of attributes;

processing the plurality of points so as to be identified by the group by generating a line having the point representing data included in the group, wherein the processing includes linking the plotted data with a curved line per-thread based on the subject of the e-mail to represent the stream;

displaying the processed graph on a display apparatus;

detecting an action performed by a user by detecting an absolute position of the user'"'"'s hand and finger in the three-dimensional space by an operation detecting device;

moving, rotating, zooming in, and zooming out the graph displayed on the display apparatus depending on the user'"'"'s action detected by the operation detecting device; and

displaying, on the display apparatus, contents of the data adjacent to a part that the user is attempting to pinch, as preview images in the positions corresponding to the respective data.

8. A non-transitory computer-readable recording medium storing an information processing program to control an information processing system, the information processing program causing the information processing system as:

an information processing device;

a display apparatus; and

an operation detecting device,

wherein the information processing device includes a storage circuit that stores a plurality of pieces of data having four types of attributes indicating a subject of an e-mail, time of sending and receiving of the e-mail, frequency of sending and receiving of the e-mail, and a count of e-mail recipients, and a control circuit,

wherein the control circuit that;

allocates the time sending and receiving of the e-mail, the frequency of sending and receiving of the e-mail, and the count of e-mail recipients as three mutually different attributes to respective axes of a three-dimensional space;

generates a graph plotting the plurality pieces of stored data of the e-mail on the three-dimensional space as respective points corresponding to the plurality pieces of data;

classifies the plurality pieces of plotted data into groups using an attribute indicating the subject of the e-mail of the four type of attributes; and

processes the plurality of points so as to be identified by the group by generating a line having the point representing data included in the group, wherein the processing includes linking the plotted data with a curved line per-thread abased on the subject of the e-mail to represent the stream,

wherein the display apparatus displays the graph processed by the control circuit,

the operation detecting device detects an action performed by a user by detecting an absolute position of the user'"'"'s hand and finger in the three-dimensional space,

the control circuit moves, rotates, zooms in, and zooms out the graph displayed on the display apparatus depending on the user'"'"'s action detected by the operation detecting device, and

the control circuit display, on the display apparatus, contents of the data adjacent to a part that the user is attempting to pinch, as preview images in the positions corresponding to the respective data.