DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND RECORDING MEDIUM

• US 20160291687A1
• Filed: 04/03/2014
• Published: 10/06/2016
• Est. Priority Date: 05/21/2013
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: KASAHARA, Shunichi
• Application Number:
  US14/891,350
• Publication Number:
  US 20160291687A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1454 : involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2354/00 : Aspects of interface with display user
• CPC Class Codes: G09G 2370/022 : Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: H04N 5/64 : Constructional details of receivers, e.g. cabinets or dust covers furniture aspects of television cabinets A47B81/06

Abstract

[Object] To achieve a further improvement of the usability of wearable displays.

[Solution] Provided is a display control device including: a spatial relationship acquisition unit configured to acquire information indicating a spatial relationship between a wearable display and a terminal device; an operation acquisition unit configured to acquire information indicating an operation input acquired by the terminal device; and a display control unit configured to control display of a picture on a display unit of the wearable display based on the operation input and the spatial relationship.

Claims

1. A display control device comprising:

a spatial relationship acquisition unit configured to acquire information indicating a spatial relationship between a wearable display and a terminal device;

an operation acquisition unit configured to acquire information indicating an operation input acquired by the terminal device; and

a display control unit configured to control display of a picture on a display unit of the wearable display based on the operation input and the spatial relationship.

2. The display control device according to claim 1,

wherein the display control unit allows a picture having an object placed in a reference space to be displayed on the display unit.

3. The display control device according to claim 2,

wherein the display control unit selects a reference space in which the object is placed from among a plurality of candidates.

4. The display control device according to claim 3,

wherein the display control unit represents the selected reference space using a display effect of the object.

5. The display control device according to claim 4,

wherein the display control unit represents the selected reference space by a type of a cursor displayed when the object is selected.

6. The display control device according to claim 3,

wherein the plurality of candidates include a first reference space, a second reference space, and a third reference space, which are different from each other, and

wherein the display control unit determines whether the object undergoes a transition to the second reference space or a transition to the third reference space depending on a type of the operation input on the object placed in the first reference space.

7. The display control device according to claim 3,

wherein the plurality of candidates include a first reference space using an operation surface of the terminal device as a reference, a second reference space using a display surface of the picture as a reference, and a third reference space defined by a real space.

8. The display control device according to claim 1,

wherein the spatial relationship acquisition unit acquires information indicating at least a positional relationship between the wearable display and the terminal device, and

wherein the display control unit controls display of the picture based on the operation input and a change in the positional relationship.

9. The display control device according to claim 8,

wherein the operation acquisition unit acquires information indicating contact with a touch sensor included in the terminal device, and

wherein the display control unit allows a picture having an object placed in a reference space to be displayed on the display unit and uses the contact as an operation input to select the object.

10. The display control device according to claim 9,

wherein the display control unit allows the selected object to be moved depending on a change in the positional relationship.

11. The display control device according to claim 9,

wherein the spatial relationship acquisition unit acquires information indicating a position in a depth direction with respect to the display unit of the terminal device, and

wherein the display control unit allows the selected object to be enlarged or reduced depending on a change in the position in the depth direction.

12. The display control device according to claim 9,

wherein the display control unit places the object in a reference space using an operation surface of the terminal device as a reference during selection of the object by the contact.

13. The display control device according to claim 1,

wherein the spatial relationship acquisition unit acquires information indicating at least a posture relationship between the wearable display and the terminal device, and

wherein the display control unit controls display of the picture based on the operation input and the posture relationship.

14. The display control device according to claim 13,

wherein the operation acquisition unit acquires information indicating a movement of a contact position on a touch sensor included in the terminal device, and

wherein the display control unit allows a picture having an object placed in a reference space to be displayed on the display unit and allows the object to be moved depending on the movement of the contact position.

15. The display control device according to claim 14,

wherein the display control unit changes a movement direction of the contact position into a movement direction of the object based on the posture relationship.

16. A display control method comprising:

acquiring information indicating a spatial relationship between a wearable display and a terminal device;

acquiring information indicating an operation input acquired by the terminal device; and

controlling display of a picture on a display unit of the wearable display based on the operation input and the spatial relationship.

17. A recording medium having a program recorded thereon, the program causing a computer to execute:

a function of acquiring information indicating a spatial relationship between a wearable display and a terminal device;

a function of acquiring information indicating an operation input acquired by the terminal device; and

a function of controlling display of a picture on a display unit of the wearable display based on the operation input and the spatial relationship.