TOUCH FEE INTERFACE FOR AUGMENTED REALITY SYSTEMS

• US 20160291699A1
• Filed: 04/04/2016
• Published: 10/06/2016
• Est. Priority Date: 09/19/2011
• Status: Abandoned Application

• Current Assignee: eyeSight Mobile Technologies Ltd.
• Original Assignee: eyeSight Mobile Technologies Ltd.
• Inventors: Katz, Itay, Shenfeld, Amnon
• Application Number:
  US15/090,527
• Publication Number:
  US 20160291699A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

A method and system for augmented reality. Images of a real world scene are obtained from one or more from one or more image sensors. An orientation and/or location of the image sensors is obtained from one or more state sensors. A real world object at which a predefined pointing object is performing a predefined gesture in the images of the real world scene is identified and data associated with the identified object is displayed on a viewing device. The invention also provides a computer program comprising computer program code means for performing all the steps of the method of the invention when said program is run on a computer.

Claims

1-56. -56. (canceled)

57. An augmented reality device, comprising:

at least one processor configured to;

receive, from an image sensor, image information associated with a real world scene;

detect, in the image information, a predefined hand gesture performed by the user; and

record at least one of video information or audio information associated with a time prior to the detected predefined hand gesture and based, at least in part, on the detection.

58. The augmented reality device of claim 57, wherein the time is a predefined amount of time defined by the user.

59. The augmented reality device of claim 57, wherein the at least one processor is further configured to cause a video or audio recording associated with the image information to be tagged based, at least in part, on the detection or detection of a second predefined hand gesture.

60. The augmented reality device of claim 59, wherein the video or audio recording is a real-time video recording.

61. The augmented reality device of claim 57, wherein the audio information includes sounds recorded by a microphone.

62. The augmented reality device of claim 57, wherein the at least one processor is further configured to detect a second predefined hand gesture in the image information.

63. The augmented reality device of claim 62, wherein the at least one processor is further configured to stop recording the at least one of video information or audio information in response to the detected second predefined hand gesture.

64. The augmented reality device of claim 62, wherein the at least one processor is further configured to change a recording mode from a first mode to a second mode.

65. The augmented reality device of claim 62, wherein the at least one processor is further configured to zoom in or out in response to the detected second predefined hand gesture.

66. The augmented reality device of claim 62, wherein the at least one processor is further configured to capture a frame from the video information in response to the detected second predefined hand gesture.

67. The augmented reality device of claim 62, wherein the at least processor is further configured to run a tracking algorithm that tracks an identified real world object in the image information, in response to the detected second predefined hand gesture.

68. A method of operating an augmented reality device, the method performed by at least one processor and comprising:

receiving, from an image sensor, image information associated with a real world scene;

detecting, in the image information, a predefined hand gesture performed by the user; and

recording at least one of video information or audio information associated with a time prior to the detected predefined hand gesture and based, at least in part, on the detection.

69. The method of claim 68, wherein the time is a predefined amount of time defined by the user.

70. The method of claim 68, further comprising causing a video or audio recording associated with the image information to be tagged based, at least in part, on the detection or detection of a second predefined hand gesture.

71. The method of claim 70, wherein the video or audio recording is a real-time video recording.

72. The method of claim 68, wherein the audio information includes sounds recorded by a microphone.

73. The method of claim 68, wherein the at least one processor is further configured to change a recording mode from a first mode to a second mode.

74. The method of claim 73, further comprising stopping recording the at least one of video information or audio information in response to the detected second predefined hand gesture.

75. The method of claim 73, further comprising stopping recording the at least one of video information or audio information and change a recording mode a first mode to a second mode.

76. The method of claim 73, further comprising capturing a frame from the video information in response to the detected second predefined hand gesture.

77. The method of claim 73, further comprising running a tracking algorithm that tracks an identified real world object in the image information, in response to the detected second predefined hand gesture.

78. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method of operating an augmented reality device, the method comprising:

receiving, from an image sensor, image information associated with a real world scene;

detecting, in the image information, a predefined hand gesture performed by the user; and

recording at least one of video information or audio information associated with a time prior to the detected predefined hand gesture and based, at least in part, on the detection.