METHOD AND SYSTEM FOR TOUCHLESS ACTIVATION OF A DEVICE

• US 20160162039A1
• Filed: 07/21/2014
• Published: 06/09/2016
• Est. Priority Date: 07/21/2013
• Status: Abandoned Application

• Current Assignee: PointGrab Ltd.
• Original Assignee: PointGrab Ltd.
• Inventors: Eilat, Eran, GAD, Assaf, Perski, Haim
• Application Number:
  US14/906,559
• Publication Number:
  US 20160162039A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A method and system are provided for computer vision based control of a device by obtaining an image via a camera, the camera in communication with a device; detecting in the image a user pointing at the camera; and controlling the device based on the detection of the user pointing at the camera.

Claims

1-45. -45. (canceled)

46. A method for computer vision based control of a device, the method comprising:

obtaining an image via a camera; and

using a processor to

detect in the image a user indicating at a location relative to the camera, and

control a device based on the detection of the user indicating at the location relative to the camera.

47. The method of claim 46 wherein controlling the device comprises generating an ON/OFF command.

48. The method of claim 46 wherein controlling the device comprises modulating a level of device output.

49. The method of claim 46 comprising using the processor to apply a shape detection algorithm to detect a shape of the user indicating at the location relative to the camera.

50. The method of claim 49 comprising changing the camera frame rate based on the detection of the shape of the user indicating at the location relative to the camera.

51. The method of claim 49 comprising using the processor to detect the shape of the user indicating at the camera based on a single frame.

52. The method of claim 46 wherein using the processor to detect a user indicating at the camera comprises detecting a user'"'"'s face partially occluded around an area of the user'"'"'s eyes.

53. The method of claim 46 wherein using the processor to detect a user indicating at the location relative to the camera comprises detecting a combined shape of the user'"'"'s face and the user'"'"'s hand, the user'"'"'s hand being held away from the user'"'"'s face.

54. The method of claim 46 wherein using the processor to detect a user indicating at the location relative to the camera comprises detecting a combined shape of the user'"'"'s face and the user'"'"'s hand in a pointing posture.

55. The method of claim 46 wherein using the processor to detect a user indicating at the location relative to the camera comprises detecting a static posture of the user.

56. The method of claim 46 wherein the location relative to the camera comprises the location of the camera.

57. The method of claim 46 comprising identifying the user and using the processor to control a device based on the detection of the user indicating at the location relative to the camera and based on the identification of the user.

58. A method for computer vision based control of a device, the method comprising:

using a processor to detect in an image a user'"'"'s face partially occluded around an area of the user'"'"'s eyes; and

control the device based on the detection of the partially occluded face.

59. The method of claim 58 comprising using the processor to detect a shape of the partially occluded face.

60. The method of claim 58 comprising using the processor to detect the partially occluded face in a single image.

61. A system for touchless control of a device, the system comprising:

a camera to obtain an image of at least part of a user; and

a processor to detect in the image a user indicating at the camera, and control a device based on the detection of the user indicating at the camera.

62. The system of claim 61 wherein the processor is to detect the user indicating at the camera based on detection of a shape of the user indicating at the camera.

63. The system of claim 61 comprising a mark located at predetermined location relative to the camera and wherein the processor is to detect in the image the user indicating at the mark and to control the device based on the detection of the user indicating at the camera and at the mark.

64. The system of claim 61 comprising an indicator configured to create an indicator field of view which correlates with the camera field of view for providing indication that the user is within the camera field of view.

65. The system of claim 61 wherein the device is selected from the group consisting of:

a TV, DVD player, PC, mobile phone or tablet, camera, Set Top Box or streamer, smart home console or specific home appliances.