METHOD FOR GENERATING AN AUGMENTED REALITY CONTENT AND TERMINAL USING THE SAME

• US 20140210710A1
• Filed: 01/28/2014
• Published: 07/31/2014
• Est. Priority Date: 01/28/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: SHIN, Daekyu, CHO, Kyusung, CHO, Ikhwan
• Granted Patent: US 10,386,918 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

A method for generating augmented reality content includes receiving an augmented reality mode execution request for generating augmented reality content based on electronic book content, activating a camera in response to the request to provide a preview image, loading book data of the electronic book on the preview image, detecting an event occurring in the augmented reality mode, retrieving reaction data pre-mapped to the event, and loading the reaction data on the preview image.

Claims

1. An augmented reality content generation method, comprising:

receiving an augmented reality mode execution request for generating the augmented reality content based on electronic book content;

executing a camera in response to the request, and providing a preview image;

loading book data of the electronic book on the preview image;

detecting an event occurring in the augmented reality mode;

extracting reaction data pre-mapped to the event; and

loading the extracted reaction data on the preview image.

2. The method of claim 1, further comprising selecting default data to be presented on the preview image from the book data of the electronic book in the augmented reality mode.

3. The method of claim 1, further comprising:

recognizing an object, person, and background of a real environment provided as the preview image; and

determining the coordinates of the object, person, and background on the preview image.

4. The method of claim 3, wherein the reaction data is loaded at an identical coordinate area as the book data or another coordinate area adjacent to the book data.

5. The method of claim 3, wherein the book data is loaded on an area of reference coordinates recognized as a flat surface through coordinate detection on the preview image.

6. The method of claim 1, wherein detecting the event comprises at least one of:

detecting a motion of a user in the preview image; and

detecting sensor values obtained by a sensor unit of the mobile terminal.

7. The method of claim 6, wherein the sensor unit comprises at least one of acceleration sensor, gravity sensor, compass sensor, gyro sensor, temperature sensor, and motion sensor.

8. The method of claim 6, further comprising storing the reaction data mapped to motions of the user and sensor values, in a mapping table.

9. The method of claim 6, wherein the reaction data changes a shape of the book data or replaces the book data according to the detection of the event.

10. The method of claim 1, wherein the book data of the electronic book comprises at least one of character image data, audio data, vibration data, video data, 2-Dimensional (2D) graphic data, and 3D graphic data, with the exception of basic background image data.

11. The method of claim 1, wherein loading the book data of the electronic book comprises:

converting text data of the electronic book to speech data; and

outputting the speech data.

12. The method of claim 1, further comprising storing the preview image, on which the reaction data and the book data are loaded.

13. A mobile terminal configured to generate augmented reality content, the terminal comprising:

a display unit configured to display a preview image converted from an execution screen of an electronic book in an augmented reality mode and present book data of the electronic book and reaction data retrieved according to an event;

a storage unit configured to store the book data, the reaction data, and the preview image on which the book data and reaction data are loaded; and

a control unit configured to activate a camera to acquire the preview image, obtain motion of a user or sensor values in the augmented reality mode, retrieve reaction data based on the motion of the user or sensor values, and load the book data and reaction data to generate the augmented reality content.

14. The terminal of claim 13, wherein the control unit comprising:

an electronic book data acquisition module which parses at least one page of the electronic book to extract the book data and sends the book data to the display unit;

a preview image acquirer which acquires the preview image from the camera;

a default data extractor which extracts default data from the book data to be output onto the preview image in the augmented reality mode;

a specific event detector which detects motion of the user or acquires sensor values in the augmented reality mode;

a reaction data extractor which extracts the reaction data pre-mapped to the motion of the user or the sensor values; and

a manager module which activates the preview image acquirer, default data extractor, specific event detector, and reaction data extractor in response to the augmented reality mode execution request.

15. The terminal of claim 13, wherein the control unit recognizes an object, person, and background of a real environment provided as the preview image and determines the coordinates of the object, person, and background on the preview image.

16. The terminal of claim 15, wherein the reaction data is loaded at an identical coordinate area as the book data or other coordinate area adjacent to the book data.

17. The terminal of claim 15, wherein the book data is loaded on an area of reference coordinates recognized as a flat surface through coordinate detection on the preview image.

18. The terminal of claim 15, wherein the control unit stores the reaction data mapped to motions of the user and sensor values in a mapping table, converts text data of the electronic book to speech data, and outputs the speech data.

19. The terminal of claim 13, wherein the reaction data changes a shape of the book data or replaces the book data according to the detection of the event.

20. The terminal of claim 13, wherein the book data of the electronic book comprises at least one of character image data, audio data, vibration data, video data, 2-Dimensional (2D) graphic data, and 3D graphic data, with the exception of basic background image data.