Method and computing device for providing augmented reality

• US 9,911,231 B2
• Filed: 09/16/2014
• Issued: 03/06/2018
• Est. Priority Date: 10/08/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Subramanian, Muthukumar, Mishra, Pankaj
• Primary Examiner(s): AMIN, JWALANT B
• Application Number:
  US14/487,543
• Publication Number:
  US 20150097865A1
• Time in Patent Office: 1,267 Days
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 2201/3256 colour related metadata, e.g. colour, ICC profiles for use made of colour related metadata see the appropriate place, e.g. H04N1/60, H04N1/60 and subgroups

Abstract

A method and computing device for providing Augmented Reality (AR) is provided. The method of providing AR includes detecting at least one physical object from a real scene obtained through a camera of a computing device, rendering at least one virtual object at a desired position of the detected at least one physical object on the real scene provided on a display, enabling communication through a command for interaction between the rendered at least one virtual object, and enabling the at least one virtual object to perform an action in response to command communication between the at least one virtual object.

Claims

1. A method of providing Augmented Reality (AR) on a computing device, the method comprising:

detecting a first physical object and a second physical object from a real scene obtained through a camera of the computing device;

displaying the first physical object and the second physical object on a display;

rendering a first virtual object, at a position with regard to the displayed first physical object, and a second virtual object, at a position with regard to the displayed second physical object, on the real scene provided on the display;

in response to a first command to the first virtual object, triggering the first virtual object to perform a first action corresponding to the first command, the first command being a first type of command acting on a virtual object;

in response to the first action, initiating a second command which is communicated from the first virtual object to the second virtual object, the second command being a second type of command which is used in communication between virtual objects; and

in response to receiving the second command, triggering the second virtual object to perform a second action corresponding to the second command.

2. The method of claim 1, further comprising sending the first command as an input to the at least one of the first virtual object or the second virtual object.

3. The method of claim 1, wherein the triggering of the second virtual object to perform the second action comprises:

processing the second command; and

enabling the second virtual object to perform the second action in response to the second command being received by the second virtual object.

4. The method of claim 1, further comprising:

initiating a handshake, to confirm performing of the first action or the second action, between the first virtual object and the second virtual object; and

storing states corresponding to the first virtual object and the second virtual object during communication between the first virtual object and the second virtual object.

5. The method of claim 1, wherein the first action or the second action comprises at least one of a touch, a grab, a movement, or a release.

6. The method of claim 1, wherein the first action or the second action is performed based on detection of particular events.

7. The method of claim 6, wherein the particular events are values corresponding to at least one of a state of the first virtual object, a state of the second virtual object, a surrounding environment of the first virtual object, a surrounding environment of the second virtual object, or relative motion between the first virtual object and the second virtual object.

8. The method of claim 1, further comprising providing multimedia effects to the first virtual object or the second virtual object or providing real-time effects to the first action performed by the first virtual object or the second action performed by the second virtual object, during communication between the first virtual object and the second virtual object.

9. A computing device configured to provide Augmented Reality (AR), the computing device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor,

wherein the at least one processor is configured to;

detect a first physical object and a second physical object from a real scene obtained through a camera,

display the first physical object and the second physical object on a display,

render the first virtual object, at a position with regard to the displayed first physical object, and a second virtual object, at a position with regard to the displayed second physical object, on the real scene provided on the display,

in response to a first command to the first virtual object, trigger the first virtual object to perform a first action corresponding to the first command, the first command being a first type of command acting on a virtual object,

in response to the first action, initiate a second command which is communicated from the first virtual object to the second virtual object, the second command being a second type of command which is used in communication between virtual objects, and

in response to receiving the second command, trigger the second virtual object to perform a second action corresponding to the second command.

10. The computing device of claim 9, wherein the at least one processor is further configured to send the first command as an input to at least one of the first virtual object or the second virtual object to communicate the second command.

11. The computing device of claim 9, wherein, to render the at least one of the first virtual object or the second virtual object to perform the first action or the second action, the at least one processor is further configured to process the second command sent from the first virtual object to the second virtual object and enable the second virtual object to perform the second action in response to the second command being received by the second virtual object.

12. The computing device of claim 9,

wherein the at least one processor is further configured to initiate a handshake, to confirm performing of the first action or the second action, between the first virtual object and the second virtual object, and

wherein the memory is configured to store states corresponding to the first virtual object and the second virtual object during communication between the first virtual object and the second virtual object.

13. The computing device of claim 9, wherein the first action or the second action is performed based on detection of particular events.

14. The computing device of claim 13, wherein the particular events are values corresponding to at least one of a state of the first virtual object or the second virtual object, a surrounding environment of the first virtual object or the second virtual object, or relative motion between the first virtual object and the second virtual object.

15. The computing device of claim 9, wherein the memory stores a database which is connected to the at least one processor and is configured to store information about handshakes between the first virtual object and the second virtual object and information about the first virtual object and the second virtual object.

16. The computing device of claim 9, wherein the at least one processor is further configured to provide multimedia effects to the first virtual object or the second virtual object or to provide real-time effects to the first action performed by the first virtual object or the second action performed by the second virtual object, during communication between the first virtual object and the second virtual object.

17. A non-transitory computer-readable recording medium having recorded thereon a program for executing a method of providing Augmented Reality (AR) on a computing device, the method comprising:

detecting a first physical object and a second physical object from a real scene obtained through a camera of the computing device;

displaying the first physical object and the second physical object on a display;

rendering a first virtual object, at a position with regard to the displayed first physical object, and a second virtual object, at a position with regard to the displayed second physical object, on the real scene provided on the display;

in response to a first command to the first virtual object, triggering the first virtual object to perform a first action corresponding to the first command, the first command being a first type of command acting on a virtual object;

in response to the first action, initiating a second command which is communicated from the first virtual object to the second virtual object, the second command being a second type of command which is used in communication between virtual objects; and

in response to receiving the second command, triggering the second virtual object to perform a second action corresponding to the second command.

18. The non-transitory computer-readable recording medium of claim 17, wherein the communicating of the the second command is automatically performed without user interaction with the computing device.