METHOD OF GENERATING AND REPRODUCING MOVING IMAGE DATA BY USING AUGMENTED REALITY AND PHOTOGRAPHING APPARATUS USING THE SAME

• US 20120081529A1
• Filed: 09/23/2011
• Published: 04/05/2012
• Est. Priority Date: 10/04/2010
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: SEO, Kyung-yul
• Application Number:
  US13/242,683
• Publication Number:
  US 20120081529A1
• Time in Patent Office: Days
• US Class Current: 348/61
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method of generating and reproducing moving image data by using augmented reality (AR) and a photographing apparatus using the method includes features of capturing a moving image, receiving augmented reality information (ARI) of the moving image, and generating a file including the ARI while simultaneously recording the captured moving image. Accordingly, when moving image data is recorded, an ARI file including ARI is also generated, thereby providing an environment in which the ARI is usable when reproducing the recorded moving image data.

Claims

1. A method of generating moving image data, the method comprising:

capturing a moving image;

receiving augmented reality information (ARI) of the moving image; and

generating a file comprising the ARI while simultaneously recording the captured moving image.

2. The method as claimed in claim 1, further comprising inserting the file comprising the ARI into data of the captured moving image.

3. The method as claimed in claim 1, wherein the ARI is divided on a tag basis and is tag information which comprises information seen in an augmented reality (AR) and reproduction information necessary to reproduce the moving image data.

4. The method as claimed in claim 3, wherein the information seen in the AR comprises at least one of global positioning system (GPS) coordinates, gyro (G) sensor information, temperature information, user-defined information, a date at which the moving image has been acquired, and general information regarding the moving image, and the reproduction information comprises one of an area and a coordinate in which a reproducing apparatus is touchable when reproducing the moving image data.

5. The method as claimed in claim 3, wherein the ARI comprises identification (ID) information which is generated through arbitrary combinations of the GPS coordinates, the G sensor information, the temperature information, the user-defined information, the date at which the moving image has been acquired, and the general information regarding the moving image.

6. The method as claimed in claim 1, wherein the ARI is received at preset time intervals.

7. The method as claimed in claim 6, wherein web information related to detailed information comprises text information regarding the moving image, still image information, and moving image information.

8. The method as claimed in claim 1, wherein the ARI is received by wireless through a wireless network or by wire through a storage device which stores information related to the captured moving image.

9. The method as claimed in claim 1, wherein the file comprising the ARI is a file which is made and generated by a user.

10. The method as claimed in claim 1, wherein a file name of the file comprising the ARI is equal to a file name of the captured moving image data.

11. A method of reproducing moving image data, the method comprising:

searching for an ARI file comprising ARI of a moving image; and

executing the searched ARI file while simultaneously displaying the moving image data.

12. The method as claimed in claim 11, wherein the ARI is divided on a tag basis and is tag information which comprises information seen in an AR and reproduction information necessary to reproduce included with the moving image.

13. The method as claimed in claim 12, wherein the information seen in the AR comprises at least one of GPS coordinates, G sensor information, temperature information, user-defined information, a date at which the moving image has been acquired, and general information regarding the moving image, and the reproduction information comprises one of an area and a coordinate in which a reproducing apparatus is touchable when reproducing the moving image data.

14. The method as claimed in claim 11, wherein the ARI is information to search for detailed information of the moving image and is information to access web information related to the detailed information.

15. The method as claimed in claim 14, wherein the web information related to the detailed information comprises text information of the moving image, still image information, and moving image information.

16. The method as claimed in claim 11, wherein the moving image data into which the ARI has been inserted is received by wireless through a wireless network or by wire through a storage device.

17. The method as claimed in claim 11, wherein the display of the moving image data comprises overlapping and displaying the ARI with the moving image data through an On Screen Display (OSD).

18. The method as claimed in claim 11, further comprising receiving a request to access the detailed information of the moving image through the ARI from a user,

wherein if the request is received, the detailed information which is related to the moving image and exists on a website is accessed to be displayed to the user.

19. The method as claimed in claim 18, wherein the detailed information which is related to the moving image and accessed through the ARI is at least one of text information, still image information, and moving image information.

20. The method as claimed in claim 18, wherein if the request is received, reproduction of currently displayed moving image data is ended, and the detailed information which is accessed through the ARI and related to the moving image is displayed.

21. The method as claimed in claim 18, wherein if the request is received, reproduction of currently displayed moving image data is paused, and the accessed detailed information related to the moving image is displayed as a picture-in-picture (PIP) image.

22. A photographing apparatus comprising:

a photographing unit to capture a moving image;

a receiver to receive ARI of the moving image; and

a controller to generate a file comprising the ARI while simultaneously recording the captured moving image.

23. The photographing apparatus as claimed in claim 22, wherein the controller inserts the file comprising the ARI into data of the captured moving image to generate a file.

24. The photographing apparatus as claimed in claim 22, wherein the ARI is divided on a tag basis and is tag information which comprises information seen in an AR and reproduction information necessary to reproduce the moving image data.

25. The photographing apparatus as claimed in claim 24, wherein the information seen in the AR comprises at least one of GPS coordinates, G sensor information, temperature information, user-defined information, a date at which the moving image has been acquired, and general information regarding the moving image, and the reproduction information comprises one of an area and a coordinate in which a reproducing apparatus is touchable when reproducing the moving image data.

26. The photographing apparatus as claimed in claim 24, wherein the ARI comprises ID information which is generated through arbitrary combinations of the GPS coordinates, the G sensor information, the temperature information, the user-defined information, the date at which the moving image has been acquired, and the general information regarding the moving image.

27. The photographing apparatus as claimed in claim 22, wherein a file name of the file comprising the ARI is equal to a file name of the captured moving image data.

28. The photographing apparatus as claimed in claim 27, wherein web information related to detailed information comprises text information related to the moving image, still image information, and moving image information.

29. The photographing apparatus as claimed in claim 22, wherein the receiver receives the moving image data, into which the ARI is inserted, by wireless through a wireless network or by wire through a storage device.

30. The photographing apparatus as claimed claim 22, further comprising a display unit to execute and display an ARI file along with the moving image data.

31. The photographing apparatus as claimed in claim 30, wherein the display unit overlaps and displays the ARI with the moving image data through an OSD.

32. The photographing apparatus as claimed in claim 30, further comprising an input unit to receive a request for information related to the moving image from a user,

wherein if the request of the user is received from the input unit, the display unit accesses the detailed information, which is related to the moving image and exists on a website, to display the detailed information to the user.

33. The photographing apparatus as claimed in claim 32, wherein the input unit is a touch pad which is provided on the display unit.

34. The photographing apparatus as claimed in claim 32, wherein the detailed information which is related to the moving image and accessed through the ARI is at least one of text information, still image information, and moving image information.

35. The photographing apparatus as claimed in claim 32, wherein if the request of the user is received from the input unit, the display unit ends reproducing currently displayed moving image data and displays the detailed information which is accessed through the ARI and related to the moving image.

36. The photographing apparatus as claimed in claim 32, wherein if the request of the user is received from the input unit, the display unit pauses reproducing currently displayed moving image data and displays the accessed detailed information related to the moving image as a PIP image.

37. The photographing apparatus as claimed claim 22, wherein the photographing apparatus comprises one of a camera, camcorder, a smart phone, and a tablet personal computer (PC).

38. A photographing apparatus, comprising:

a display screen to display moving image data including a real image and at least one virtual object; and

a control module to generate and display detailed information of the real image in response to manipulating the at least one virtual object.

39. The photographing apparatus of claim 38, wherein the detailed information is based on ARI that is generated by a user and the control module embeds the ARI into the moving image data while displaying the moving image data.

40. The photographing apparatus of claim 38, wherein the detailed information includes text, hyperlinks, still images, moving images and sound.

42. The photographing apparatus of claim 40, further comprising a storage unit that stores the data file.

43. The photographing apparatus of claim 40, wherein the ARI data of the data file includes at least one tag indicating ARI of the real image linked to the virtual object.

44. The photographing apparatus of claim 40, wherein the ARI data is generated based on ARI received over a network.

46. The photographing apparatus of claim 40, wherein the ARI data is generated based on input data from a user of the photographing apparatus.

41. A photographing apparatus, comprising:

a display screen to display moving image data thereon; and

a control module to read a data file comprising moving image data and ARI data and to reproduce the moving image data on the display screen along with at least one virtual object linked to a real image displayed in the moving image data,

wherein the control module displays detailed information based on the ARI data of the data file in response to selecting the virtual object.

45. The photographing apparatus of claim 41, wherein the ARI data is generated based on first data determined during capturing moving images displayed in the moving image data and second data stored in the storage unit.

47. A photographing apparatus, comprising:

a photographing unit to record a captured moving image;

a storage unit to store first information; and

a controller to determine second information from the capture moving image, to generate a combined ARI based on the first information stored in the storage unit and the second information from the captured moving image, and to generate a data file comprising the combined ARI while recording the captured moving image.