Wearable display system that displays a workout guide

• US 10,169,923 B2
• Filed: 12/29/2016
• Issued: 01/01/2019
• Est. Priority Date: 02/14/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Hamada, Gen
• Primary Examiner(s): Wills, Diane
• Application Number:
  US15/394,019
• Publication Number:
  US 20170109939A1
• Time in Patent Office: 733 Days
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally

Abstract

There is provided a display control device including an action information acquisition unit that acquires, at an action position of one actor, action information regarding a past action of another actor, an object generation unit that generates a virtual object for virtually indicating a position of the other actor during an action of the one actor based on the acquired action information, and a display control unit that causes a display unit displaying a surrounding scene to superimpose and display the generated virtual object during the action of the one actor.

Claims

1. A display control device, comprising:

circuitry configured to;

acquire position information of a user of the display control device from a first sensor;

determine, based on the acquired position information, whether the user is positioned within a specific area of a real space;

control, when determining that the user is positioned within the specific area, a display unit to superimpose a guidance avatar on the real space at a position within a visual field of the user, the guidance avatar corresponding to the specific area; and

control the display unit to add a predetermined object indicating a position of the guidance avatar instead of the guidance avatar when determining that the guidance avatar is located outside the visual field of the user, wherein

the guidance avatar moves within the specific area independent from movement of the user.

2. The display control device of claim 1, wherein the predetermined object is at least partially transparent.

3. The display control device of claim 2, wherein the predetermined object is displayed in a peripheral region of a display screen of the display unit.

4. The display control device of claim 3, wherein the predetermined object is displayed in a corner of the peripheral region of the display screen of the display unit.

5. The display control device of claim 1, wherein the circuitry is further configured to:

control the display unit to display a map as the predetermined object, the map indicating a position of the user and a position of the guidance avatar.

6. The display control device according to claim 1, wherein the circuitry is further configured to:

change a scale of the guidance avatar in accordance With a position of the user and a position of the guide.

7. The display control device according to claim 6, wherein the circuitry is further configured to:

increase the scale of the guidance avatar in accordance with increase of a distance between the position of the user and the position of the guide.

8. The display control device according to claim 1, wherein

the first sensor includes a GPS, and

the circuitry is configured to:

determine, based on the acquired position information from the GPS, whether the user is positioned within a specific facility corresponding to the specific area; and

control the display unit to display the guidance avatar corresponding to the specific facility when determining that the user is positioned within the specific facility.

9. The display control device according to claim 8, wherein

the specific facility includes a plurality of specific areas, and

the circuitry is configured to determine the guidance avatar based on one of the plurality of specific areas and based on the acquired position information.

10. The display control device according to claim 8, wherein the specific facility includes at least one of a gallery, a zoo, a park, or an amusement facility.

11. The display control device according to claim 1, wherein the circuitry is further configured to:

acquire action information of the user from a second sensor;

determine whether the user is in a non-action state based on the action information; and

prevent the display unit to display the guidance avatar when determining that the user is in the non-action state based on the action information.

12. The display control device according to claim 11, wherein the second sensor includes at least one of an acceleration sensor.

13. The display control device according to claim 1, wherein the display unit is a head mounted display.

15. The display control device of claim 1, wherein the guidance avatar moves within the specific area on a basis of past movement of a person within the specific area.

16. The display control device claim 15, wherein the person corresponding to the guidance avatar is a person different from the user of the display control device.

14. The display control device according to claim wherein the display unit is a screen provided to a windshield.

17. A display control method comprising:

acquiring position information of a user of the display control device from a first sensor;

determining, based on the acquired position information, whether the user is positioned within a specific area of a real space;

controlling, when determining that the user is positioned within the specific area, a display unit to superimpose a guidance avatar on the real space at a position within a visual field of the user, the guidance avatar corresponding to the specific area; and

controlling the display unit to add a predetermined object indicating a position of the guidance avatar instead of the guidance avatar when determining that the guidance avatar is located outside the visual field of the user, wherein

the guidance avatar moves within the specific area independent from movement of the user.

18. A non-transitory computer readable medium having a computer program recorded thereon, the computer program configured to perform a method when executed on a computer, the method comprising:

acquiring position information of a user of the display control device from a first sensor;

determining, based on the acquired position information, whether the user is positioned within a specific area of a real space;

controlling, when determining that the user is positioned within the specific area, a display unit to superimpose a guidance avatar on the real space at a position within a visual field of the user, the guidance avatar corresponding to the specific area; and

controlling the display unit to add a predetermined object indicating a position of the guidance avatar instead of the guidance avatar when determining that the guidance avatar is located outside the visual field of the user, wherein

the guidance avatar moves within the specific area independent from movement of the user.