REMOTE CONTROL APPARATUS AND METHOD USING VIRTUAL REALITY AND AUGMENTED REALITY

• US 20130257858A1
• Filed: 03/01/2013
• Published: 10/03/2013
• Est. Priority Date: 03/30/2012
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yoon, Young-Kwon, Na, Jin-Hee, Kim, Pyo-jae
• Application Number:
  US13/782,647
• Publication Number:
  US 20130257858A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/6684 by dynamically adapting its position to keep a game object in its viewing frustrum, e.g. for tracking a character or a ball
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video

Abstract

Methods and apparatus are provided for using a virtual space map. The virtual space map is generated and displayed. Communication between a character of an actual space and a character on the virtual space map is controlled.

Claims

1. A remote control apparatus of a mobile terminal using a virtual space map, the remote control apparatus comprising:

a virtual space map generator for generating the virtual space map;

a display unit for displaying the virtual space map; and

a controller for controlling communication between a character of an actual space and a character on the virtual space map.

2. The remote control apparatus of claim 1, further comprising a camera unit including one or more camera modules for photographing the actual space to generate the virtual space map.

3. The remote control apparatus of claim 1, further comprising a communication unit including one or more communication modules for transmitting a command for controlling the character of the actual space, wherein the command is input through the character on the virtual space map to the character of the actual space.

4. The remote control apparatus of claim 1, wherein the controller controls communication between the character of the actual space and an augmented character displayed in the display unit.

5. The remote control apparatus of claim 1, wherein the controller controls the communication by allocating an inherent identifier allocated to the character of the actual space to the character on the virtual space map.

6. The remote control apparatus of claim 2, wherein the controller calculates a camera position in an image of the photographed actual space by using Simultaneous Localization And Mapping (SLAM).

7. The remote control apparatus of claim 1, wherein the virtual space map generator generates the virtual space map by using one of a gyro sensor, a depth sensor, a texture, a feature, annotation information on the character of the actual space, a vertex of the character of the actual space, a side, and a brightness difference in a photographed image.

8. The remote control apparatus of claim 1, wherein the character of the actual space comprises at least one of a television, a washing machine, a refrigerator, a copy machine, a computer, a digital photo frame, and an electric curtain having a communication function therein, and a desk and a bookshelf having no communication function therein.

9. The remote control apparatus of claim 1, wherein the controller controls a motion of the character on the virtual space map through a keypad, a touch input, or a motion sensor.

10. The remote control apparatus of claim 1, wherein the controller registers the character in the virtual space map or deletes the character from the virtual space map.

11. The remote control apparatus of claim 1, wherein the virtual space map is generated based on a virtual reality and an augmented reality, and mutual communication is provided through characters of different mobile terminals existing in the virtual space map.

12. A remote control method of a mobile terminal using a virtual space map, the remote control method comprising the steps of:

generating a virtual space map;

displaying the virtual space map; and

controlling communication between a character of an actual space and a character on the virtual space map.

13. The remote control method of claim 12, further comprising photographing the actual space by using one or more camera modules in order to generate the virtual space map.

14. The remote control method of claim 12, further comprising transmitting a command for controlling the character of the actual space, wherein the command is input through the character on the virtual space map to the character of the actual space.

15. The remote control method of claim 12, wherein controlling the communication comprises controlling the communication by allocating an inherent identifier allocated to the character of the actual space to the character on the virtual space map.

16. The remote control method of claim 12, wherein generating the virtual space map comprises generating the virtual space map by using one of a gyro sensor, a depth sensor, a texture, a feature, annotation information on the character of the actual space, a vertex of the character of the actual space, a side, and a brightness difference in a photographed image.

17. The remote control method of claim 12, wherein controlling the communication further comprises controlling a motion of the character on the virtual space map through a keypad, a touch input, or a motion sensor.

18. The remote control method of claim 12, wherein the virtual space map is generated based on a virtual reality and an augmented reality, and mutual communication is provided through characters of different mobile terminals existing in the virtual space map.

19. A machine readable storage medium for recording a program for executing a remote control method using a virtual space map, which when executed implements the steps of:

generating a virtual space map;

displaying the virtual space map; and

controlling communication between a character of an actual space and a character on the virtual space map.

20. An article of manufacture for performing remote control using a virtual space map, comprising a machine readable medium containing one or more programs, which when executed implements the steps of:

generating a virtual space map;

displaying the virtual space map; and

controlling communication between a character of an actual space and a character on the virtual space map.