Personal device with image-acquisition functions for the application of augmented reality resources and method

• US 20070273644A1
• Filed: 05/21/2007
• Published: 11/29/2007
• Est. Priority Date: 11/19/2004
• Status: Abandoned Application

• Current Assignee: Daem Interactive SL
• Original Assignee: Daem Interactive SL
• Inventors: Mondine Natucci, Ignacio
• Application Number:
  US11/804,974
• Publication Number:
  US 20070273644A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 1/00323 with a measuring, monitoring or signaling apparatus, e.g. for transmitting measured information to a central location

Abstract

The invention relates to a personal device with image-acquisition functions. The device comprises a first image-acquisition unit; a display screen able to display therein acquired images acquired by said first unit; a connection with a second unit suitable for: processing said acquired images for the identification of a pattern; calculating a positional reference vector, with respect to said first image-acquisition unit, of the identified pattern; and providing information, associated to said acquired image, that is able to generate a suitably dimensioned image, or set of images, taking into account said positional reference vector, suitable for being superimposed on said display screen over said acquired image or for substituting it. The method comprises using a device as the proposed for the application of augmented reality resources.

Claims

1. A personal device with image-acquisition functions for the application of augmented reality resources, comprising:

a first image-acquisition unit;

at least one display screen able to display therein at least acquired images acquired by said first unit;

a connection with a second unit suitable for;

processing one or more of said acquired images for the identification of at least one pattern;

calculating a positional reference vector, with respect to said first image-acquisition unit, of the identified pattern; and

providing information associated to said acquired image that is able to generate a suitably dimensioned image or set of images, taking into account said positional reference vector, suitable for being superimposed, on said display screen, over said acquired image.

2. A device according to claim 1, wherein said second unit is included in the device itself or forms an assembly with said first unit.

3. A device according to claim 1, wherein said second unit is at a remote point, and in that said device further includes a telecommunication unit suitable for communicating at least with said second unit.

4. A device according to claim 1, wherein the components integrating said second unit are distributed between a remote point and the device itself, and said device further includes a telecommunication unit to communicate at least with the components located at said remote point.

5. A device according to claim 1, wherein said pattern is representative of a graphic element.

6. A device according to claim 5, wherein said graphic element is part of a view of an entity.

7. A device according to claim 5, wherein said graphic element is all of a view of an entity.

8. A device according to claim 1, wherein said information that is able to generate a suitably dimensioned image, or set of images, comprises data for generating a three-dimensional or perspective image.

9. A device according to claim 3, wherein said telecommunication unit is suitable for transmitting the acquired images to said second unit or to a part thereof.

10. A device according to claim 4, wherein said telecommunication unit is suitable for transmitting the acquired images to said second unit or to a part thereof.

11. A device according to claim 9, wherein said second unit is suitable for carrying out said processing of each of the acquired images received and for returning to the device at least:

one positional reference vector for each identified pattern.

12. A device according to claim 11, wherein said second unit is suitable for further returning to the device:

an image with an associated mask for each returned positional reference vector.

13. A device according to claim 11, wherein said second unit is suitable for further returning to the device:

a mask for each returned positional reference vector so as to allow the generation of said suitably dimensioned image or set of images.

14. A device according to claim 10, wherein said second unit is suitable for carrying out said processing of each of the acquired images received and for returning to the device at least:

one positional reference vector for each identified pattern.

15. A device according to claim 14, wherein said second unit is suitable for further returning to the device:

an image with an associated mask for each returned positional reference vector.

16. A device according to claim 14, wherein said second unit is suitable for further returning to the device:

a mask for each returned positional reference vector so as to allow the generation of said suitably dimensioned image or set of images.

17. A device according to claim 16, wherein the components of said second unit located in said device are suitable for generating said suitably dimensioned image, or set of images, according to said positional reference vector or said mask returned to the device.

18. A device according to claim 17, wherein at least one of the components of said second unit located in said device has a series of images stored therein, and said components are suitable for generating said suitably dimensioned image, or set of images, by means of their selection from said series of stored images.

19. A device according to claim 18, wherein the components of said second unit located in said device are suitable for manipulating said stored images for generating said suitably dimensioned image, or set of images.

20. A device according to claim 16, wherein it is suitable for superimposing said returned or generated image over one of said acquired images, on said display screen.

21. A device according to claim 9, wherein said telecommunication unit is suitable for transmitting said acquired images to said second unit, at least in part or only in black and white.

22. A device according to claim 9, wherein said telecommunication unit is suitable for transmitting said acquired images to said second unit as whole or in part.

23. A device according to claim 1, wherein said display screen is suitable for displaying at least information relating to applications belonging to the personal device.

24. A device according to claim 23, wherein said display screen is a touch display screen allowing a user to interact and use said applications belonging to the personal device.

25. A personal device with image-acquisition functions for the application of augmented reality resources, comprising:

a first image-acquisition unit;

at least one display screen able to display therein at least acquired images acquired by said first unit;

a connection with a second unit suitable for;

processing one or more of said acquired images for the identification of at least one pattern; and

providing information associated to said acquired image that is able to generate a suitably dimensioned image, or set of images, suitable for being superimposed on said display screen over said acquired image.

26. A device according to claim 25, wherein said suitably dimensioned image is representative of a flat or perspective text message.

27. A personal device with image-acquisition functions for the application of augmented reality resources, comprising:

a first image-acquisition unit;

at least one display screen able to display therein at least acquired images acquired by said first unit;

a second unit suitable for;

processing one or more of said acquired images for the identification of at least one pattern; and

calculating a positional reference vector, with respect to said first image-acquisition unit, of the identified pattern;

and

a telecommunication unit adapted for transmitting said acquired image, or part of it, and said positional reference vector to a remote point.

28. A device according to claim 27, wherein aid second unit is adapted to receive and process information associated to said acquired image coming from said remote point, to generate a suitably dimensioned image, or set of images, taking into account said positional reference vector, suitable for being superimposed, on said display screen, over said acquired image.

29. A method for the application of augmented reality resources, comprising, by means of a personal device with image-acquisition functions, comprising:

acquiring at least one image by means of a first unit,

displaying said at least one acquired image on a display screen of said device,

sending said acquired image to a second unit,

in said second unit, at least;

processing one or more of said acquired images for the identification of at least one pattern,

calculating a positional reference vector, with respect to said first image-acquisition unit, of the identified pattern,

providing information associated to said acquired image that is able to generate a suitably dimensioned image, or set of images, taking into account said positional reference vector, suitable for being superimposed, on said display screen, over said acquired image, and

displaying on said display screen said suitably dimensioned image, or set of images, superimposed over the acquired image.

30. A method according to claim 29, wherein it comprises carrying out all the steps for a set of images, both acquired images and images generated on the basis of said provided information.

31. A method according to claim 30, wherein said set of images form a video sequence.

32. A method according to claim 29, wherein it comprises carrying out said acquisition from different angles.

33. A method according to claim 30, wherein it comprises carrying out said acquisition from different angles.

34. A method according to claim 29, wherein said provided information comprises data for generating different views of said image, or set of images, suitably dimensioned, each of them from a respective angle.

35. A method according to claim 30, wherein said provided information comprises data for generating different views of said image, or set of images, suitably dimensioned, each of them from a respective angle.

38. A method according to claim 29, wherein it comprises carrying out in real time the steps after said step of acquiring at least one image.

40. A method according to claim 38, wherein, in order to carry out said steps in real time, it comprises using an at least third generation UMTS for communicating with said second unit.

36. A method for the application of augmented reality resources, comprising, by means of a personal device with image-acquisition functions, carrying out the following steps:

acquiring at least one image by means of a first unit,

displaying said at least one acquired image on a display screen of said device,

sending said acquired image to a second unit,

in said second unit, at least;

processing one or more of said acquired images for the identification of at least one pattern,

providing information associated to said acquired image that is able to generate a suitably dimensioned image, or set of images, suitable for being superimposed, on said display screen, over said acquired image, and

displaying on said display screen said suitably dimensioned image, or set of images, superimposed over the acquired image.

37. A method according to claim 36, wherein said suitably dimensioned image is representative of a flat or perspective text message.

39. A method according to claim 36, wherein it comprises carrying out in real time the steps after said step of acquiring at least one image.

41. A method according to claim 36, wherein it also comprises carrying out the following steps:

in said second unit, after said processing of said acquired image;

providing information associated to said acquired image that is able to generate at least a sound piece suitable for being played by said personal device, and

playing by said personal device said sound piece through at least one speaker.

42. A method according to claim 36, wherein said suitably dimensioned set of images are superimposed over the acquired image, on said display screen, grouped forming a menu.

43. A method according to claim 42, wherein it comprises, when displaying said menu, running an application or function of said personal device.

44. A method according to claim 43, wherein said images forming said menu are each a link to a respective sub-application or sub-function of said application or function, and in that it comprises selecting a user, by using a corresponding input device of the personal device, at least one of said sub-applications or sub-functions and run and use it.

45. A method according to claim 42, wherein said images forming said menu are each a link to a respective application or function of said personal device, and in that it comprises selecting a user, by using a corresponding input device of the personal device, at least one of said applications or functions and run and use it.

46. A method according to claim 42, wherein said images of said menu are icons.

47. A method according to claim 42, wherein said images of said menu are text indications.