Display device, image data generating device, image data generating program, and display method

• US 8,730,319 B2
• Filed: 07/08/2011
• Issued: 05/20/2014
• Est. Priority Date: 07/09/2010
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Sekine, Masahiro, Sasaki, Takashi, Tasaki, Tsuyoshi, Okumura, Haruhiko, Morimoto, Shigeo, Yoneyama, Takahisa, Kuwabara, Yugo, Odate, Noriko
• Primary Examiner(s): Ustaris, Joseph
• Assistant Examiner(s): BAILEY, FREDERICK D
• Application Number:
  US13/178,700
• Publication Number:
  US 20120008048A1
• Time in Patent Office: 1,047 Days
• Field of Search: 348/148, 382/100, 382/102, 382/103, 382/104, 340/425.5, 340/436, 340/435, 463/33, 455/456.1, 386/291, 709/202
• US Class Current: 348/115
• CPC Class Codes: A63F 2300/305 for providing a graphical or textual hint to the player
• CPC Class Codes: A63F 2300/6009 for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content
• CPC Class Codes: A63F 2300/66 for rendering three dimensional images
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

According to one embodiment, a display device includes an image data generating unit and a display unit. The image data generating unit generates image data on an image. The display unit presents a video including the image data to an image viewer on a moving body to superimpose the video on an actual outside scene. The image data includes a first display object and a second display object. The first display object includes a lower part object. The lower part object has a lower part, an upper right part and an upper left part. A length of the lower part along a normal direction is longer than lengths of the upper right and upper left parts. The second display object is disposed in the image with reference to a display position of the first display object. The second display object includes information on the moving body.

Claims

1. A display device comprising:

an image data generating unit configured to generate image data on an image; and

a display unit configured to present a video including the image data generated by the image data generating unit to an image viewer on a moving body to superimpose the video on an actual outside scene outside the moving body,

the image data including a first display object and a second display object,

the first display object including a lower part object,

the lower part object having;

a lower part disposed in the image;

an upper right part disposed at a position on an upper and right side of the lower part in the image; and

an upper left part disposed at a position on an upper and left side of the lower part in the image,

a length of the lower part along a first normal line direction being longer than a length of the upper right part along a second normal line direction and a length of the upper left part along a third normal line direction, the first normal direction being perpendicular to a first extending direction of the lower part object at a position of the lower part, the second normal direction being perpendicular to a second extending direction of the lower part object at a position of the upper right part, the third normal direction being perpendicular to a third extending direction of the lower part object at a position of the upper left part,

the second display object being disposed in the image with reference to a display position of the first display object in the image, the second display object including information on the moving body.

2. The device according to claim 1, wherein

the second display object has a portion on an upper side of the first display object in the image.

3. The device according to claim 1, wherein:

the first display object further includes an upper part object;

the upper part object is disposed on an upper side of the lower part object; and

the upper part object is separated from the lower part object.

4. The device according to claim 3, wherein

the first display object further includes a partition line provided between the lower part object and the upper part object.

5. The device according to claim 3, wherein

the lower part object has at least one of a color different from a color of the upper part object and a brightness different from a brightness of the upper part object.

6. The device according to claim 3, wherein

an outer edge of the upper part object has a curved shape.

7. The device according to claim 3, wherein

a width of the upper part object in a lateral direction in the image is same as a width of the lower part object in the lateral direction in the image.

8. The device according to claim 3, wherein

a portion on a lower side of a boundary line of the upper part object has a projecting shape toward the lower side in the image, and

a portion on an upper side of a boundary line of the lower part object has a projecting shape toward the lower side in the image.

9. The device according to claim 3, wherein

the upper part object has a bilaterally symmetric shape with respect to a vertical direction in the image as a center axis, and

the lower part object has a bilaterally symmetric shape with respect to the vertical direction as the center axis.

10. The device according to claim 3, wherein

the first display object has a three-dimensional shape,

the upper part object includes a top surface of the three-dimensional shape, and

The lower part object includes at least one of a said surface and a bottom surface on a lower said of the top surface of the three-dimensional shape.

11. The device according to claim 1, wherein

the first display object has a shape of a lower side portion of a sphere horizontally cut as seen in a diagonal direction.

12. The device according to claim 1, wherein

the second display object includes:

a first type object disposed in the image with reference to the display position of the first display object in the image, the first type object including symbolic information; and

a second type object disposed in the image with reference to the display position of the first display object in the image, the second type object including graphic pattern information different from the first type object.

13. The device according to claim 12, wherein

the symbolic information includes at least one of a numeral and a character.

14. The device according to claim 12, wherein

the graphic pattern information relatively displays information by at least one of a shape, a size, a number, a position, a color, and a brightness of a graphic.

15. The device according to claim 1, wherein

the second display object displays information including a velocity of the moving body.

16. The device according to claim 1, wherein

the second display object includes a third type object disposed in the image with reference to the display position of the first display object in the image,

the third type object includes:

a first state object corresponding to the moving body in a first state; and

a second state object corresponding to the moving body in a second state in which a predetermined characteristic value is different from a characteristic value of the first state, the second state object being different from the first state object, and

a change with time in at least one of a shape, a size, a number, a color, a brightness, a position, and a track of the first state object is different from a change with time in the second state object.

17. The device according to claim 16, wherein

the third type object displays information on a state of the moving body by at least one of a shape, a color, and a motion of a graphic pattern.

18. An image data generating device to generate image data on an image of a display video configured to be presented to an image viewer on a moving body and to be superimposed on an actual outside scene outside the moving body,

the device configured to generate a first display object, the first display object having a lower part object,

the lower part object having:

a lower part disposed in the image;

an upper right part disposed at a position on an upper and right side of the lower part in the image; and

an upper left part disposed at apposition on an upper and left side of the lower part in the image,

a length of the lower part along a first normal line direction being longer than a length of the upper right part along a second normal line direction and a length of the upper left part along a third normal line direction, the first normal direction being perpendicular to a first extending direction of the lower part object at a position of the lower part, the second normal direction being perpendicular to a second extending direction of the lower part object at a position of the upper right part, the third normal direction being perpendicular to a third extending direction of the lower part object at a position of the upper left part,

the device being configured to generate a second display object, the second display object being disposed in the image with reference to a display position of the first display object in the image, the second display object including information on the moving body, and

the device being configured to generate the image data based on the first display object and the second display object.

19. An image data generating program stored on a non-transitory computer readable medium and configured to cause a computer to generate image data on an image of a display video configured to be presented to an image viewer on a moving body and to be superimposed on an actual outside scene outside the moving body,

the program comprising:

causing the computer to generate a first display object, the first display object including a lower part object,

the lower part object having;

a lower part disposed in an image;

an upper right part disposed at a position on an upper and right side of the lower part in the image; and

an upper left part disposed at a position on an upper and left side of the lower part in the image,

a length of the lower part along a first normal line direction being longer than a length of the upper right part along a second normal line direction and a length of the upper left part along a third normal line direction, the first normal direction being perpendicular to a first extending direction of the lower part object at a position of the lower part, the second normal direction being perpendicular to a second extending direction of the lower part object at a position of the upper right part, the third normal direction being perpendicular to a third extending direction of the lower part object at a position of the upper left part,

causing the computer to generate a second display object, the second display object being disposed in the image with reference to a display position of the first display object in the image, the second display object including information on the moving body; and

causing the computer to generate the image data based on the first display object and the second display object.

20. A display method comprising:

generating image data on an image, the image data including;

a first display object; and

a second display object,

the first display object including a lower part object, the lower part object having;

a lower part disposed in the image;

an upper right part disposed at a position on an upper and right side of the lower part in the image; and

an upper left part disposed at apposition on an upper and left side of the lower part in the image,

a length of the lower part along a first normal line direction being longer than a length of the upper right part along a second normal line direction and a length of the upper left part along a third normal line direction, the first normal direction being perpendicular to a first extending direction of the lower part object at a position of the lower part, the second normal direction being perpendicular to a second extending direction of the lower part object at a position of the upper right part, the third normal direction being perpendicular to a third extending direction of the lower part object at a position of the upper left part,

the second display object being disposed in the image with reference to a display position of the first display object in the image, the second display object including information on a moving body; and

presenting the display video based on the image data to an image viewer on a moving body to superimpose a display video on an actual outside scene outside the moving body.