Graphical user interface device

• US 8,726,156 B2
• Filed: 08/06/2008
• Issued: 05/13/2014
• Est. Priority Date: 08/07/2007
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Kitabayashi, Kazuyoshi
• Primary Examiner(s): ITURRALDE, ENRIQUE W
• Application Number:
  US12/186,955
• Publication Number:
  US 20090044116A1
• Time in Patent Office: 2,106 Days
• Field of Search: 715/735, 715/778, 715/779, 715/781, 715201-204, 715716-718, 715/733, 715736-742, 715/744, 715750-753, 715/756, 715/759, 715/761, 715/767, 715/866
• US Class Current: 715/716
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 5/7408 Direct viewing projectors, e.g. an image displayed on a video CRT or LCD display being projected on a screen

Abstract

The disclosure refers to a graphical user interface device. In one example, the device is configured to provide images for display on a plurality of split screen forming areas of a split screen display. The device displays to a user an operation window having operation areas, the number of operation areas being the same as the number of split screen forming areas of the split screen display. Each of the operation areas is associated with one of the split screen forming areas.

Claims

1. A graphical user interface device configured to have a projector display a combined image including a first area and a second area, the graphical user interface device comprising:

an image display device configured to display an operation window including a first operation area which corresponds to the first area and a second operation area which corresponds to the second area, the first operation area and the second operation area being arranged in a specified arrangement;

an allocation unit tangibly embodied as computer-executable instructions on at least one non-transitory computer-readable storage medium, the allocation unit being configured to allocate the graphical user interface device to the first operation area, and to allocate one of a plurality of participant devices to the second operation area; and

a controller configured to have the projector display the combined image in which a first image, that is displayed by the image display device of the graphical user interface device, is displayed in the first area and in which a second image, that is displayed by a participant device allocated to the second operation area, is displayed in the second area such that the first area and the second area are displayed in the specified arrangement.

2. The graphical user interface device according to claim 1, wherein the first and second operation areas are arranged in a same positional relation as a layout of the first and second areas.

3. The graphical user interface device according to claim 1, wherein the allocation unit is configured to allocate the first or second image associated with each of the first and second operation areas to the corresponding first or second area.

4. The graphical user interface device according to claim 1, further comprising a switching unit associated with each of the first and second operation areas, each switching unit being tangibly embodied as computer-executable instructions on at least one non-transitory computer-readable storage medium, each switching unit being configured to switch the first or second image associated with the first or second operation area from being displayed on one of the first and second areas in a split screen display to being displayed in a non-split screen, full-screen display.

5. The graphical user interface device according to claim 3, further comprising:

a switching unit associated with each of the first and second operation areas, each switching unit being tangibly embodied as computer-executable instructions on at least one non-transitory computer-readable storage medium, each switching unit being configured to switch the first or second image associated with the first or second operation area from being displayed on one of the first and second areas in a split screen display to being displayed in a non-split screen, full-screen display,

wherein the allocation unit is configured to permit selective association of a new image to the first or second operation area while the switching unit is switching from displaying the first or second image in the split screen display to displaying the first or second image in the full-screen display.

6. The graphical user interface device according to claim 1, further comprising a second unit tangibly embodied as computer-executable instructions on at least one non-transitory computer-readable storage medium, the second unit being configured to display in each of the first and second operation areas a thumbnail of the first or second image displayed in the first or second area corresponding to the first or second operation area.

7. The graphical user interface device according to claim 1, further comprising:

a third unit configured to change at least one of a number of split screen forming areas that includes the first and second areas and a layout of the number of split screen forming areas; and

a fourth unit configured to change a number of operation areas that includes the first and second operation areas in accordance with the changed number of the split screen forming areas and change a layout of the number of operation areas in accordance with the changed layout of the split screen forming areas,

wherein the third unit and the fourth unit are each tangibly embodied as computer-executable instructions on at least one non-transitory computer-readable storage medium.

8. The graphical user interface device according to claim 1, further configured to:

read a predefined data set;

upon receiving a connection request from a participant device, permit a connection if the participant device belongs to the predefined data set;

select at least two participant devices for display on the image display device and assigning each of these participant devices to one of the first and second operation areas;

receive image data from each of the at least two participant devices;

combine the image data from the at least two participant devices to form the first and second images; and

provide the first and second images for display on the first and second areas.

9. The graphical user interface device according to claim 8, wherein the predefined data set comprises hourly profile data and class makeup profile data.

10. The graphical user interface device according to claim 1, wherein the graphical user interface device is implemented within a personal computer.

11. A conference system including:

the graphical user interface device of claim 1; and

the projector displaying the combined image including the first area and the second area.

12. The graphical user interface device according to claim 1, further configured to display to a user a list of participant devices that are connected to the graphical user interface device and a status of whether image data from each of the participant devices is being transmitted to the projector.

13. The graphical user interface device according to claim 1, further configured to receive a selection of a projector for displaying the first and second images on the image display device, and receiving a selection of a screen display setting for configuring the number of first and second areas of the image display device.

14. The graphical user interface device according to claim 1, wherein each of the first and second operation areas have a colored window and each of the first and second areas include a screen frame having a distinguishing color, each of the windows of the first and second operation areas having a same color as the color of the screen frame of the first or second area associated with the first or second operation area.

16. The graphical user interface device according to claim 1, wherein the first image and the second image are not displayed in the operation window.

17. The graphical user interface device according to claim 1, further comprising a fifth unit tangibly embodied as computer-executable instructions on at least one non-transitory computer-readable storage medium, the fifth unit being configured to display, on the image display device, a preview window that is separate from the operation window, the preview window including at least one of the first image and the second image.

15. A graphical user interface device configured to have a projector display a combined image including a first area and a second area, the graphical user interface device comprising:

an image display device configured to display an operation window including a first operation area which corresponds to the first area and a second operation area which corresponds to the second area, each of the first and second operation areas having a visually recognizable corresponding relation with one of the first and second areas, the first operation area and the second operation area being arranged in a specified arrangement;

an allocation unit tangibly embodied as computer-executable instructions on at least one non-transitory computer-readable storage medium, the allocation unit being configured to allocate the graphical user interface device to the first operation area, and to allocate one of a plurality of participant devices to the second operation area; and

a controller configured to have the projector display the combined image in which a first image, that is displayed by the image display device of the graphical user interface device, is displayed in the first area and in which a second image, that is displayed by a participant device allocated to the second operation area, is displayed in the second area such that the first area and the second area are displayed in the specified arrangement.

18. A method for displaying, by a projector, a combined image including a first area and a second area, the method comprising:

displaying, on an image display device of a graphical user interface device, an operation window including a first operation area which corresponds to the first area and a second operation area which corresponds to the second area, the first operation area and the second operation area being arranged in a specified arrangement;

allocating the graphical user interface device to the first operation area;

allocating one of a plurality of participant devices to the second operation area; and

displaying, by the projector, the combined image in which a first image, that is displayed by the image display device of the graphical user interface device, is displayed in the first area and in which a second image, that is displayed by a participant device allocated to the second operation area, is displayed in the second area such that the first area and the second area are displayed in the specified arrangement.

19. The method according to claim 18, wherein the first and second operation areas are arranged in a same positional relation as a layout of the first and second areas.

20. The method according to claim 18, further comprising:

allocating the first or second image associated with each of the first and second operation areas to the corresponding first or second area.

21. The method according to claim 20, further comprising:

switching the first or second image associated with the first or second operation area from being displayed on one of the first and second areas in a split screen display to being displayed in a non-split screen, full-screen display;

permitting selective association of a new image to the first or second operation area while the switching unit is switching from displaying the first or second image in the split screen display to displaying the first or second image in the full-screen display.

22. The method according to claim 18, further comprising:

switching the first or second image associated with the first or second operation area from being displayed on one of the first and second areas in a split screen display to being displayed in a non-split screen, full-screen display.

23. The method according to claim 18, further comprising:

displaying in each of the first and second operation areas a thumbnail of the first or second image displayed in the first or second area corresponding to the first or second operation area.

24. The method according to claim 18, further comprising:

changing at least one of a number of split screen forming areas that includes the first and second areas and a layout of the number of split screen forming areas;

changing a number of operation areas that includes the first and second operation areas in accordance with the changed number of the split screen forming areas; and

changing a layout of the number of operation areas in accordance with the changed layout of the split screen forming areas.

25. The method according to claim 18, further comprising:

reading a predefined data set;

upon receiving a connection request from a participant device, permitting a connection if the participant device belongs to the predefined data set;

selecting at least two participant devices for display on the image display device and assigning each of these participant devices to one of the first and second operation areas;

receiving image data from each of the at least two participant devices;

combining the image data from the at least two participant devices to form the first and second images; and

providing the first and second images for display on the first and second areas.

26. The method according to claim 25, wherein the predefined data set comprises hourly profile data and class makeup profile data.

27. The method according to claim 18, further comprising:

displaying to a user a list of participant devices that are connected to the graphical user interface device and a status of whether image data from each of the participant devices is being transmitted to the projector.

28. The method according to claim 18, further comprising:

receiving a selection of a projector for displaying the first and second images on the image display device; and

receiving a selection of a screen display setting for configuring the number of first and second areas of the image display device.

29. The method according to claim 18, wherein each of the first and second operation areas have a colored window and each of the first and second areas include a screen frame having a distinguishing color, each of the windows of the first and second operation areas having a same color as the color of the screen frame of the first or second area associated with the first or second operation area.

30. The method according to claim 18, wherein the first image and the second image are not displayed in the operation window.

31. The method according to claim 18, further comprising:

displaying, on the image display device, a preview window that is separate from the operation window, the preview window including at least one of the first image and the second image.

32. A method for displaying, by a projector, a combined image including a first area and a second area, the method comprising:

displaying, on an image display device of a graphical user interface device, an operation window including a first operation area which corresponds to the first area and a second operation area which corresponds to the second area, each of the first and second operation areas having a visually recognizable corresponding relation with one of the first and second areas, the first operation area and the second operation area being arranged in a specified arrangement;

allocating the graphical user interface device to the first operation area;

allocating one of a plurality of participant devices to the second operation area; and

displaying, by the projector, the combined image in which a first image, that is displayed by the image display device of the graphical user interface device, is displayed in the first area and in which a second image, that is displayed by a participant device allocated to the second operation area, is displayed in the second area such that the first area and the second area are displayed in the specified arrangement.

33. A computer program product comprising instructions recorded on at least one non-transitory computer-readable storage medium and executable by a computer to display, by a projector, a combined image including a first area and a second area, the instructions executable to perform:

displaying, on an image display device of a graphical user interface device, an operation window including a first operation area which corresponds to the first area and a second operation area which corresponds to the second area, the first operation area and the second operation area being arranged in a specified arrangement;

allocating the graphical user interface device to the first operation area;

allocating one of a plurality of participant devices to the second operation area; and

displaying, by the projector, the combined image in which a first image, that is displayed by the image display device of the graphical user interface device, is displayed in the first area and in which a second image, that is displayed by a participant device allocated to the second operation area, is displayed in the second area such that the first area and the second area are displayed in the specified arrangement.

34. The computer program product according to claim 33, wherein the first and second operation areas are arranged in a same positional relation as a layout of the first and second areas.

35. The computer program product according to claim 33, wherein the instructions are executable to further perform:

allocating the first or second image associated with each of the first and second operation areas to the corresponding first or second area.

36. The computer program product according to claim 35, wherein the instructions are executable to further perform:

switching the first or second image associated with the first or second operation area from being displayed on one of the first and second areas in a split screen display to being displayed in a non-split screen, full-screen display;

permitting selective association of a new image to the first or second operation area while the switching unit is switching from displaying the first or second image in the split screen display to displaying the first or second image in the full-screen display.

37. The computer program product according to claim 33, wherein the instructions are executable to further perform:

switching the first or second image associated with the first or second operation area from being displayed on one of the first and second areas in a split screen display to being displayed in a non-split screen, full-screen display.

38. The computer program product according to claim 33, wherein the instructions are executable to further perform:

displaying in each of the first and second operation areas a thumbnail of the first or second image displayed in the first or second area corresponding to the first or second operation area.

39. The computer program product according to claim 33, wherein the instructions are executable to further perform:

changing at least one of a number of split screen forming areas that includes the first and second areas and a layout of the number of split screen forming areas;

changing a number of operation areas that includes the first and second operation areas in accordance with the changed number of the split screen forming areas; and

changing a layout of the number of operation areas in accordance with the changed layout of the split screen forming areas.

40. The computer program product according to claim 33, wherein the instructions are executable to further perform:

reading a predefined data set;

upon receiving a connection request from a participant device, permitting a connection if the participant device belongs to the predefined data set;

selecting at least two participant devices for display on the image display device and assigning each of these participant devices to one of the first and second operation areas;

receiving image data from each of the at least two participant devices;

combining the image data from the at least two participant devices to form the first and second images; and

providing the first and second images for display on the first and second areas.

41. The computer program product according to claim 40, wherein the predefined data set comprises hourly profile data and class makeup profile data.

42. The computer program product according to claim 33, wherein the computer program product is implemented within a personal computer.

43. A conference system including:

the computer program product according to claim 33; and

the projector displaying the combined image including the first area and the second area.

44. The computer program product according to claim 33, wherein the instructions are executable to further perform:

displaying to a user a list of participant devices that are connected to the graphical user interface device and a status of whether image data from each of the participant devices is being transmitted to the projector.

45. The computer program product according to claim 33, wherein the instructions are executable to further perform:

receiving a selection of a projector for displaying the first and second images on the image display device; and

receiving a selection of a screen display setting for configuring the number of first and second areas of the image display device.

46. The computer program product according to claim 33, wherein each of the first and second operation areas have a colored window and each of the first and second areas include a screen frame having a distinguishing color, each of the windows of the first and second operation areas having a same color as the color of the screen frame of the first or second area associated with the first or second operation area.

47. The computer program product according to claim 33, wherein the first image and the second image are not displayed in the operation window.

48. The computer program product according to claim 33, wherein the instructions are executable to further perform:

displaying, on the image display device, a preview window that is separate from the operation window, the preview window including at least one of the first image and the second image.

49. A computer program product comprising instructions recorded on at least one non-transitory computer-readable storage medium and executable by a computer to display, by a projector, a combined image including a first area and a second area, the instructions executable to further perform:

displaying, on an image display device of a graphical user interface device, an operation window including a first operation area which corresponds to the first area and a second operation area which corresponds to the second area, each of the first and second operation areas having a visually recognizable corresponding relation with one of the first and second areas, the first operation area and the second operation area being arranged in a specified arrangement;

allocating the graphical user interface device to the first operation area;

allocating one of a plurality of participant devices to the second operation area; and

displaying, by the projector, the combined image in which a first image, that is displayed by the image display device of the graphical user interface device, is displayed in the first area and in which a second image, that is displayed by a participant device allocated to the second operation area, is displayed in the second area such that the first area and the second area are displayed in the specified arrangement.