METHOD FOR DISPLAYING AUGMENTATION INFORMATION IN AN AUGMENTED REALITY SYSTEM

• US 20120026191A1
• Filed: 07/05/2010
• Published: 02/02/2012
• Est. Priority Date: 07/05/2010
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Aronsson, Par-Anders, Backlund, Erik, Kristensson, Andreas
• Application Number:
  US13/143,132
• Publication Number:
  US 20120026191A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions

Abstract

A method for displaying augmentation information in an augmented reality system (100) is provided. According to the method a reality information is detected with an imaging device (102) and a human face (200) is automatically detected in the reality information. Depending on the detected human face (200) a predetermined mapping is automatically assigned to the reality information. The mapping comprises a plurality of mapping areas (1-17) in which augmentation information can be displayed.

Claims

1-14. -14. (canceled)

15. A method for displaying augmentation information in an augmented reality system, the method comprising:

detecting reality information with an imaging device, the reality information comprising an image of an environment of the imaging device,

automatically detecting a human face in the reality information,

automatically assigning a predetermined mapping to the reality information depending on the detected human face, the mapping comprising a plurality of mapping areas configured to display augmentation information, and

displaying the augmentation information in a predetermined mapping area of the plurality of mapping areas.

16. The method according to claim 15, wherein the predetermined mapping comprises a default mapping comprising a plurality of mapping areas assigned to areas of the human face.

17. The method according to claim 15, wherein the predetermined mapping comprises a default mapping comprising a plurality of mapping areas assigned to areas adjacent to the human face.

18. The method according to claim 15, comprising:

automatically recognizing a person from a plurality of persons based on the human face comprised in the reality information,

providing a plurality of mappings, each of the mappings being respectively assigned to one person of the plurality of persons, and

automatically assigning the mapping assigned to the recognized person to the reality information.

19. The method according to claim 18, wherein the augmentation information comprises information about the recognized person.

20. The method according to claim 15, wherein the mapping is configurable by a user of the augmented reality system.

21. The method according to claim 15, wherein the augmentation information is configurable by a user of the augmented reality system.

22. The method according to claim 15, wherein the mapping area where the augmentation information is displayed is configurable by a user of the augmented reality system.

23. The method according to claim 15, wherein the augmentation information comprises at least one information of the group comprising Email information, calendar information, appointment information, and time of the day information.

24. The method according to claim 15, wherein the augmentation information comprises visual control information, the visual control information indicating an actuation of a function of the augmented reality system, wherein the method comprises:

automatically tracking the eyes of a user of the augmented reality system,

automatically detecting if the user is looking at the visual control information, and

automatically actuating the function of the augmented reality system upon detecting that the user is looking at the visual control information.

25. An augmented reality system, comprising:

an imaging device for detecting reality information, the reality information comprising an image of an environment of the imaging device,

a display unit adapted to display augmentation information in combination with the reality information, and

a processing unit coupled to the imaging device and the display unit, wherein the processing unit is adapted to detect a human face in the reality information, assign a predetermined mapping to the reality information depending on the detected human face, the mapping comprising a plurality of mapping areas, and display the augmentation information in a predetermined mapping area of the plurality of mapping areas.

26. The augmented reality system according to claim 25, wherein the display unit comprises eyeglasses adapted display the reality information overlaid with the augmentation information.

27. The augmented reality system according to claim 25, wherein the display unit is adapted to display the reality information and the augmentation information simultaneously.

28. The augmented reality system according to claim 25, wherein the processing unit is adapted to automatically recognize a person from a plurality of persons based on the human face comprised in the reality information and assign the predetermined mapping assigned to the recognized person to the reality information.

29. The augmented reality system according to claim 28, wherein the augmentation information comprises information about the recognized person.

30. The augmented reality system according to claim 25, wherein the augmentation information comprises visual control information indicating an actuation of a function of the augmented reality system.

31. The augmented reality system according to claim 30, wherein the system is adapted to automatically track the eyes of a user of the system, detect if the user is looking at visual control information and actuate the function of the system upon detecting that the user is looking at the visual control information.

32. The augmented reality system according to claim 25, wherein the mapping is configurable by a user of the augmented reality system.

33. The augmented reality system according to claim 25, wherein the augmentation information is configurable by a user of the augmented reality system.

34. The augmented reality system according to claim 25, wherein the mapping area where the augmentation information is displayed is configurable by a user of the augmented reality system.

35. The augmented reality system according to claim 25, wherein the augmentation information comprises at least one information of the group comprising Email information, calendar information, appointment information, and time of the day information.