Mobile terminal device and image display method

• US 20050034084A1
• Filed: 08/03/2004
• Published: 02/10/2005
• Est. Priority Date: 08/04/2003
• Status: Abandoned Application

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Hijiri, Toshiki, Orimoto, Katsunori, Ohtsuki, Toshikazu, Uesaki, Akira, Mochizuki, Yoshiyuki
• Application Number:
  US10/909,307
• Publication Number:
  US 20050034084A1
• Time in Patent Office: Days
• US Class Current: 715/864
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: H04M 1/72439 for image or video messaging

Abstract

A mobile terminal device 100 comprises an object unit 100a operable to generate and store various kinds of objects composed of three-dimensional objects, a database unit 100b operable to store information displayed for the three-dimensional objects, a key input unit 100c operable to perform input processing by input keys such as cursor keys, a rendering unit 100d operable to render various kinds of objects passed by the object unit 100a based on the position information and a display unit 100e operable to generate and display images to be displayed on the display screen.

Claims

1. A mobile terminal device comprising:

an object generation unit operable to generate an object;

a texture generation unit operable to generate a second texture image for a piece of related information relating to a first texture image;

a texture mapping unit operable to map the first texture image, and the second texture image generated by the texture generation unit, onto the object generated by the object generation unit so as to generate an image object;

a block object generation unit operable to generate a block object by placing a plurality of image objects in three-dimensional space based on corresponding pieces of related information so as to generate a block object;

an image generation unit operable to generate an image of the block object; and

a display unit operable to display the image generated by the image generation unit.

2. The mobile terminal device according to claim 1,

wherein the object generation unit generates a two-dimensional object,

the texture mapping unit generates image objects by mapping the first texture image onto a front surface of the two-dimensional object, and the second texture image onto a portion or a whole of peripheral part of the two-dimensional object,

the block generation unit generates a block object by placing two-dimensional image objects in a diagonal direction in the three-dimensional space based on pieces of related information so that at least a part of image objects placed backward can be recognized,

the image generation unit generates images of the block objects, and

the display unit displays the images.

3. The mobile terminal device according to claim 2,

wherein the first texture images include character information, and the second texture images include pieces of color information that are classified into categories of the first texture images.

4. The mobile terminal device according to claim 1,

wherein the object generation unit generates a three-dimensional object,

the texture mapping unit generates image objects by mapping the first texture image onto front surfaces of the three-dimensional object, the second texture image onto a side surface of the three-dimensional objects,

the block generation unit generates a block object by placing the plurality of the image objects based on the pieces of related information so that the image objects construct a polyhedron in the three-dimensional space,

the image generation unit generates images of the block object, and

the display unit displays the images.

5. The mobile terminal device according to claim 1,

wherein the texture generation unit generates the second texture images for classifying the pieces of related information of the first texture images into some categories by color, pattern, gradation or shape.

6. The mobile terminal device according to claim 1, further comprising:

an image storage unit operable to store the first texture images; and

an information storage unit operable to store position information on where the pieces of related information and the block object are placed,

wherein, the image generation unit generates images of the block object based on the position information.

7. The mobile terminal device according to claim 1,

wherein the pieces of related information include at least one of (i) a piece of information concerning images:

time of image generating;

time of image shooting;

a date;

recording duration;

an image size;

brightness; and

a color, and (ii) a piece of information concerning details of image shooting and help information for the mobile terminal device;

a location of image shooting;

a favorite degree;

a genre; and

a reference frequency,

the mobile terminal device further comprises

an ordering change unit operable to change ordering of the image objects based on the pieces of related information, and

the block generation unit generates a block object by placing the image objects in the three-dimensional space based on the change made by the ordering change unit.

8. The mobile terminal device according to claim 1, further comprising:

a viewpoint shifting unit operable to arbitrarily shift a viewpoint on a display screen according to an input from a user; and

a position information generation unit operable to generate position information from the viewpoint after shifting by the viewpoint shifting unit,

wherein the image generation unit generates images of the block object based on the position information after shifting, and

the display unit displays the images.

9. The mobile terminal device according to claim 1, further comprising an extraction unit operable to extract feature information indicating features of images from the first texture images,

wherein the feature information includes at least one of:

information on people in an image;

information on color used in an image; and

information on brightness used in an image.

10. The mobile terminal device according to claim 9,

wherein the extraction unit records the feature information in the information storage unit as related information.

11. The mobile terminal device according to claim 1, further comprising:

a cursor key input unit operable to shift a position of a cursor displayed on a display screen to a position desired by a user according to an instruction from the user;

an enter key input unit operable to select the image object on which the cursor is placed; and

a decision unit operable to decide whether the image object selected by the enter key input unit should be selected or not.

12. The mobile terminal device according to claim 1,

wherein the block generation unit generates a block object by placing a group of image objects related to each other as an album in the three-dimensional space based on the pieces of related information,

the image generation unit generates at least one block object corresponding to the album, and

the display unit displays the images.

13. The mobile terminal device according to claim 1,

wherein the object generation unit further generates:

(a) a cursor object that is an arrow displayed on a display screen;

(b) a frame cursor object indicating a viewpoint on the block object;

(c) an axis object that is an arrow indicating time information of the block object; and

(d) a balloon object including a thumbnail image of the image object indicated by the cursor object.

14. The mobile terminal device according to claim 1, further comprising

a mode selection unit operable to select a display mode from a plurality of display modes for the three-dimensional object,

wherein the image generation unit generates images by placing the image object, the block object, the cursor object, the frame cursor object, the axis object, or the balloon object in the three-dimensional space depending on display modes,

the display unit displays the images.

15. The mobile terminal device according to claim 14,

wherein the display mode is one of:

(a) a block display mode where one or more block objects that are classified into a group are placed in the three-dimensional space;

(b) a thumbnail display mode where images of a block object can be searched by shifting a cursor object via the cursor key input unit;

(c) an image display mode where the first texture images are displayed;

(d) an information input mode where pieces of information concerning the block object and the image object are inputted; and

(e) a display information selection mode where pieces of information are displayed on respective surfaces of a block object.

16. The mobile terminal device according to claim 15,

wherein, in the case where the thumbnail display method is selected by the mode selection unit, the image generation unit generates images by placing the block object, the cursor object, the frame cursor object, the balloon object, the image object and the axis object in the three-dimensional space based on position information.

17. The mobile terminal device according to claim 15,

wherein, in the case where the block display mode is selected by the mode selection unit, the image generation unit generates one of (i) an image where the plurality of block objects and the cursor object are placed in the three-dimensional space and (ii) an image where one of the plurality of block objects is placed, and the image to be displayed is changed one after another by the cursor key input unit.

18. The mobile terminal device according to claim 15,

wherein, in the case where the image display mode is selected by the mode selection unit, the display unit displays the first texture images entered by the enter key input unit on the display screen.

19. The mobile terminal device according to claim 15, further comprising

an information input unit operable to obtain information from a user concerning the first texture images,

wherein, in the case where the information input mode is selected in the mode selection unit, the display unit displays the first texture images entered by the enter key input unit and an input box where information is inputted by the information input unit.

20. The mobile terminal device according to claim 15,

wherein, in the case where the display information selection mode is selected by the mode selection unit, the display unit displays a development of the image object entered by the enter key input unit and a display information selection box for selecting display information on the display screen.

21. The mobile terminal device according to claim 1,

wherein the block generation unit generates the block object by placing the image objects on the block object that is cylindrical.

22. The mobile terminal device according to claim 1, further comprising

a second texture mapping unit operable to generate moving image objects by mapping digital moving images and pieces of related information of the digital moving images onto the objects.

29. The mobile terminal device according to claim 2, further comprising:

an image storage unit operable to store the first texture images; and

an information storage unit operable to store position information on where the pieces of related information and the block object are placed,

wherein, the image generation unit generates images of the block object based on the position information.

30. The mobile terminal device according to claim 4, further comprising:

an image storage unit operable to store the first texture images; and

an information storage unit operable to store position information on where the pieces of related information and the block object are placed,

wherein, the image generation unit generates images of the block object based on the position information.

23. An image display method comprising:

an object generation step of generating an object;

a texture generation step of generating a second texture image for a piece of related information relating to a first texture image;

a texture mapping step of mapping the first texture image and the second texture image generated in the texture generation step onto the object generated in the object generation step so as to generate an image object;

a block generation step of placing a plurality of two dimensional image objects in the three-dimensional space based on the pieces of related information so as to generate a block object;

an image generation step of generating images of the block object; and

a display step of displaying images generated in the image generation step.

24. The image display method according to claim 23,

wherein, in the object generation step, a two-dimensional object is generated,

in the texture mapping step, image object is generated by mapping the first texture image onto front surface of the two-dimensional object, and the second texture image onto a portion or a whole of peripheral part of the two-dimensional object,

in the block generation step, a block object is generated by placing the plurality of the two-dimensional image objects in a diagonal direction in the three-dimensional space based on the pieces of related information so that at least a part of the image objects placed backward can be recognized,

in the image generation step, images of the block object are generated, and

in the display step, the images are displayed.

25. The image display method according to claim 23,

wherein, in the object generation step, a three-dimensional object is generated,

in the texture mapping step, an image object is generated by mapping the first texture image onto front surface of the three-dimensional object, the second texture image on side surface of the three-dimensional object,

in the block generation step, a block object is generated by placing the image objects in the three-dimensional space based on the pieces of related information so that the image objects can construct a polyhedron,

in the image generation step, images of the block object are generated, and

in the display step, the images are displayed.

26. A program causing a computer to execute following steps:

an object generation step of generating an object;

a texture generation step of generating second texture image for a piece of related information relating to a first texture image;

a texture mapping step of generating an image object by mapping the first texture image and the second texture image generated in the texture generation step onto the object generated in the object generation step;

a block generation step of generating a block object by placing a plurality of the image objects in the three-dimensional space based on the pieces of related information;

an image generation step of generating images of the block object; and

a display step of displaying images generated in the image generation step.

27. A program according to claim 26,

wherein, in the object generation step, a two-dimensional object is generated,

in the texture mapping step, an image object is generated by mapping the first texture image onto front surface of the two-dimensional object, the second texture image onto a portion of or a whole peripheral part of the two-dimensional object,

in the block generation step, a block object is generated by placing a plurality of the two-dimensional block objects in a diagonal direction in the three-dimensional space based on the pieces of related information so that at least a part of image objects placed backward can be recognized,

in the image generation step, images of the block object are generated, and

in the display step, the images are displayed.

28. A program according to claim 26, comprising:

an object generation step where a three-dimensional object is generated;

a texture mapping step where an image object is generated by mapping the first texture image onto front surface of the three-dimensional object, the second texture image on side surface of the three-dimensional object;

a block generation step where block objects are generated by placing image objects in the three-dimensional space based on the pieces of related information so that the image objects can construct a polyhedron;

an image generation step where images of the block object are generated; and

a display step where the images are displayed.