TOUCH FEE INTERFACE FOR AUGMENTED REALITY SYSTEMS

• US 20160259423A1
• Filed: 03/03/2016
• Published: 09/08/2016
• Est. Priority Date: 09/19/2011
• Status: Abandoned Application

• Current Assignee: eyeSight Mobile Technologies Ltd.
• Original Assignee: eyeSight Mobile Technologies Ltd.
• Inventors: Katz, Itay, Shenfeld, Amnon
• Application Number:
  US15/060,533
• Publication Number:
  US 20160259423A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

A method and system for augmented reality. Images of a real world scene are obtained from one or more from one or more image sensors. An orientation and/or location of the image sensors is obtained from one or more slate sensors. A real world object at which a predefined pointing object is performing a predefined gesture in the images of the real world scene is identified and data associated with the identified object is displayed on a viewing device. The invention also provides a computer program comprising computer program code means for performing all the steps of the method of the invention when said program is run on a computer.

Claims

1-56. -56. (canceled)

57. An augmented reality device having a plurality of operation modes, comprising:

at least one processor configured to;

receive, from an image sensor, image information associated with a real world scene;

output, to a display, visual data associated with the received image information to enable a user to view the visual data, and view at least a portion of the real world scene in a see-through area of the display;

detect, in the image information, a predefined gesture performed by the user; and

change an operation mode of the augmented reality device from a first operation mode to a second operation mode associated with the detected predefined gesture.

58. The augmented reality device of claim 57, wherein the change in operation mode comprises selecting a source of visual material to be presented.

59. The augmented reality device of claim 57, wherein the change in operation mode comprises selecting a level of detail of visual material to be presented.

60. The augmented reality device of claim 57, wherein the change in operation mode comprises selecting one or more buttons or activatable icons to be presented on the display.

61. The augmented reality device of claim 57, wherein the change in operation mode comprises activating an online service.

62. The augmented reality device of claim 61, wherein the online service is related to a selected real world object.

63. The augmented reality device of claim 57, wherein the change in operation mode comprises a change in a number of frames per second of the received image information being analyzed.

64. The augmented reality device of claim 57, wherein the change in operation mode comprises a change in one or more gestures to be identified.

65. The augmented reality device of claim 57, wherein the change in operation mode comprises a change in one or more algorithms that are active in a gesture detection module.

66. The augmented reality device of claim 57, wherein the change in operation mode comprises a change in an operation mode of the image sensor.

67. The augmented reality device of claim 66, wherein the change in operation mode comprises a change in a capture rate of images captured by the image sensor.

68. The augmented reality device of claim 66, wherein the change in a resolution of images captured by the image sensor.

69. The augmented reality device of claim 57, wherein the change in operation mode comprises a change from a standby mode to an active mode.

70. The augmented reality device of claim 69, wherein the change from the standby mode to the active mode is associated a change in a number of video frames per second of the received image information being analyzed.

71. The augmented reality device of claim 69, wherein the change from the standby mode to the active mode is associated with an availability of visual data associated with the real world scene for output on a display of the augmented reality device.

72. A method for operating an augmented reality device having a plurality of operation modes, comprising:

receiving, by at least one processor from an image sensor, image information associated with a real world scene;

outputting, to a display, visual data associated with the received image information to enable a user to view the visual data, and view at least a portion of the real world scene in a see-through area of the display;

detecting, by the at least one processor in the image information, a predefined gesture performed by the user; and

changing, by the at least one processor, an operation mode of the augmented reality device from a first operation mode to a second operation mode associated with the detected predefined gesture.

73. The method of claim 72, wherein the change in operation mode comprises a change in a number of frames per second of the received image information being analyzed.

74. The method of claim 72, wherein the change in operation mode comprises a change in one or more gestures to be identified.

75. The method of claim 72, wherein the change in operation mode comprises a change in one or more algorithms that are active in a gesture detection module.

76. The method of claim 72, wherein the change in operation mode comprises a change in an operation mode of the image sensor.

77. The method of claim 76, wherein the change in operation mode comprises a change in a capture rate of images captured by the image sensor.

78. The method of claim 76, wherein the change in operation mode comprises a change in a resolution of images captured by the image sensor.

79. The method of claim 72, wherein the change in operation mode comprises a change from a standby mode to an active mode.

80. The method of claim 79, wherein the change from the standby mode to the active mode is associated with a change in a number of video frames per second of the received image information being analyzed.

81. The method of claim 79, wherein the change from the standby mode to the active mode is associated with an availability of visual data associated with the real world scene for output on a display of the augmented reality device.

82. A non-transitory computer readable medium having stored thereon instructions which, when executed, cause one or more processors to perform a method for operating an augmented reality device having a plurality of operation modes, the method comprising:

receiving image information associated with a real world scene;

outputting, to a display, visual data associated with the received image information to enable a user to view the visual data, and view at least a portion of the real world scene in a see-through area of the display;

detecting, by the at least one processor in the image information, a predefined gesture performed by the user; and

changing, by the at least one processor, an operation mode of the augmented reality device from a first operation mode to a second operation mode associated with the detected predefined gesture.