Mobile object, system, and storage medium

• US 9,616,901 B2
• Filed: 07/24/2015
• Issued: 04/11/2017
• Est. Priority Date: 08/08/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sakoda, Kazuyuki, Sako, Yoichiro, Asada, Kohei, Aratani, Katsuhisa, Watanabe, Kazuhiro, Nakamura, Takatoshi, Takehara, Mitsuru, Koga, Yuki, Hanaya, Hiroyuki, Onuma, Tomoya, Tange, Akira
• Primary Examiner(s): Marc, McDieunel
• Application Number:
  US14/808,123
• Publication Number:
  US 20150329122A1
• Time in Patent Office: 627 Days
• Field of Search: 701 2, 701500, 701512, 340407, 340 2, 340439, 340506, 340576, 340905
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/265 Voice
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60W 50/082 Selecting or switching between different modes of propelling
• CPC Class Codes: B60W 50/087 where the control system corrects or modifies a request from the driver
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04L 65/40 Support for services or applications
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04W 4/38 for collecting sensor information

Abstract

There is provided a mobile object including an input detection unit configured to detect an input from an outside, an acquisition unit configured to acquire environmental information detected by a sensor in a remote location, in accordance with a content of detection performed by the input detection unit, and a control unit configured to control an actuator other than a driving actuator in accordance with the environmental information acquired by the acquisition unit, the driving actuator relating to movement of the mobile object.

Claims

1. A server, comprising:

circuitry configured to;

communicate with a remotely located user device and an information processing apparatus;

generate virtual object display information corresponding to instruction information received from the remotely located user device, wherein the instruction information is a user input to environmental information detected by a sensor at a location in the real world; and

transmit the virtual object display information to the information processing apparatus for superimposing a virtual object corresponding to the virtual object display information on a scene of the location in the real world.

2. The server according to claim 1, wherein the circuitry is further configured to receive an image detected by the sensor at the location in the real world.

3. The server according to claim 1, wherein the circuitry is further configured to receive a sound detected by the sensor at the location in the real world.

4. The server according to claim 1, wherein the virtual object is a vehicle.

5. The server according to claim 1, wherein the virtual object is determined based on the user input.

6. The server according to claim 1, wherein the circuitry is further configured to:

receive a sound detected by the sensor at the location in the real world; and

transmit the received sound to the information processing apparatus for reproduction of the sound.

7. The server according to claim 6, wherein the received sound is a driving sound of a vehicle.

8. A method, comprising:

in a server;

communicating with a remotely located user device and an information processing apparatus;

generating virtual object display information corresponding to instruction information received from the remotely located user device, wherein the instruction information is a user input to environmental information detected by a sensor at a location in the real world; and

transmitting the virtual object display information to the information processing apparatus for superimposing a virtual object corresponding to the virtual object information on a scene of the location in the real world.

9. The method according to claim 8, further comprising receiving an image detected by the sensor at the location in the real world.

10. The method according to claim 8, further comprising receiving a sound detected by the sensor at the location in the real world.

11. The method according to claim 8, wherein the virtual object is a vehicle.

12. The method according to claim 8, wherein the virtual object is determined based on the user input.

13. The method according to claim 8, further comprising:

receiving a sound detected by the sensor at the location in the real world; and

transmitting the received sound to the information processing apparatus for reproduction of the sound.

14. The method according to claim 13, wherein the received sound is a driving sound of a vehicle.

15. A non-transitory computer-readable medium having stored thereon a set of computer-executable instructions which when executed by a computer causes the computer to perform steps comprising:

communicating with a remotely located user device and an information processing apparatus;

generating virtual object display information corresponding to instruction information received from the remotely located user device, wherein the instruction information is a user input to environmental information detected by a sensor at a location in the real world; and

transmitting the virtual object display information to the information processing apparatus for superimposing a virtual object corresponding to the virtual object information on a scene of the location in the real world.

16. The non-transitory computer-readable medium according to claim 15, the steps further comprising receiving an image detected by the sensor at the location in the real world.

17. The non-transitory computer-readable medium according to claim 15, the steps further comprising receiving a sound detected by the sensor at the location in the real world.

18. The non-transitory computer-readable medium according to claim 15, wherein the virtual object is a vehicle.

19. The non-transitory computer-readable medium according to claim 15, wherein the virtual object is determined based on the user input.

20. The non-transitory computer-readable medium according to claim 15, the steps further comprising:

receiving a sound detected by the sensor at the location in the real world; and

transmitting the received sound to the information processing apparatus for reproduction of the sound.