Systems and methods of direct pointing detection for interaction with a digital device
First Claim
Patent Images
1. A method of recognizing an aimed point or area in a viewing space of a display device, the method comprising:
- obtaining, using an image sensor, at least one image of the viewing space;
processing the at least one image by at least one processor operatively connected to the image sensor and obtaining data indicative of a location of at least one pointing element in the viewing space;
obtaining data indicative of a location of at least one predefined body part of a user in the viewing space;
determining by the at least one processor, a location of the aimed point or area in the viewing space using a combination of;
the data indicative of the location of the at least one pointing element,the data indicative of the location of the at least one predefined body part, andfeatures with respect to a motion path of the pointing element during a pointing gesture;
determining the aimed point or area, while obtaining the data indicative of the location of at least one pointing element in the viewing space;
detecting a change in an estimated time until the pointing element will reach a point in the viewing space where the pointing element is closest to the aimed point or area during the pointing gesture;
determining a change in a motion vector of the pointing element during the pointing gesture, wherein the change in the motion vector relates to a change in a direction of the motion vector in a vertical axis; and
executing a predefined command or message associated with at least the aimed point or area and the change in the motion vector.
0 Assignments
0 Petitions
Accused Products
Abstract
A method of recognizing an aimed point on a plane is provided. Images captured by one or more image sensor are processed for obtaining data obtaining data indicative of location of at least one pointing element in the viewing space and data indicative of at least one predefined user'"'"'s body part in the viewing space; using the obtained data an aimed point on the plane is identified. In case it is determined that a predefined condition is met a predefined command and/or message is executed.
-
Citations
20 Claims
-
1. A method of recognizing an aimed point or area in a viewing space of a display device, the method comprising:
-
obtaining, using an image sensor, at least one image of the viewing space; processing the at least one image by at least one processor operatively connected to the image sensor and obtaining data indicative of a location of at least one pointing element in the viewing space; obtaining data indicative of a location of at least one predefined body part of a user in the viewing space; determining by the at least one processor, a location of the aimed point or area in the viewing space using a combination of; the data indicative of the location of the at least one pointing element, the data indicative of the location of the at least one predefined body part, and features with respect to a motion path of the pointing element during a pointing gesture; determining the aimed point or area, while obtaining the data indicative of the location of at least one pointing element in the viewing space; detecting a change in an estimated time until the pointing element will reach a point in the viewing space where the pointing element is closest to the aimed point or area during the pointing gesture; determining a change in a motion vector of the pointing element during the pointing gesture, wherein the change in the motion vector relates to a change in a direction of the motion vector in a vertical axis; and executing a predefined command or message associated with at least the aimed point or area and the change in the motion vector. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A non-transitory computer readable medium storing instructions which, when executed, cause at least one processor to perform operations for recognizing an aimed point or area in a viewing space of a display device, the operations comprising:
-
obtaining, using an image sensor, at least one image of the viewing space; processing the at least one image by at least one processor operatively connected to the image sensor and obtaining data indicative of a location of at least one pointing element in the viewing space; obtaining data indicative of a location of at least one predefined body part of a user in the viewing space; determining a location of the aimed point or area in the viewing space using a combination of; the data indicative of the location of the at least one pointing element, the data indicative of the location of the at least one predefined body part, and features with respect to a motion path of the pointing element during a pointing gesture; determining the aimed point or area, while obtaining the data indicative of the location of at least one pointing element in the viewing space; detecting a change in an estimated time until the pointing element will reach a point in the viewing space where the pointing element is closest to the aimed point or area during the pointing gesture; determining a change in a motion vector of the pointing element during the pointing gesture, wherein the change in the motion vector relates to a change in a direction of the motion vector in a vertical axis; and executing a predefined command or message associated with at least the aimed point or area and the change in the motion vector. - View Dependent Claims (11, 12, 13, 14, 15, 16)
-
-
17. A system for recognizing an aimed point or area in a viewing space of a display device, the system comprising:
at least one processor configured to; obtain, using an image sensor, at least one image of the viewing space; process the at least one image and obtain data indicative of a location of at least one pointing element in the viewing space; obtain data indicative of a location of at least one predefined body part of a user in the viewing space; determine a location of the aimed point or area in the viewing space using a combination of; the data indicative of the location of the at least one pointing element, the data indicative of the location of the at least one predefined body part, and features with respect to a motion path of the pointing element during a pointing gesture; determine the aimed point or area, while obtaining the data indicative of the location of at least one pointing element in the viewing space; detect a change in an estimated time until the pointing element will reach a point in the viewing space where the pointing element is closest to the aimed point or area during the pointing gesture; determine a change in a motion vector of the pointing element during the pointing gesture, wherein the change in the motion vector relates to a change in a direction of the motion vector in a vertical axis; and execute a predefined command or message associated with at least the aimed point or area and the change in the motion vector. - View Dependent Claims (18, 19)
-
20. A method of recognizing an aimed point or area in a viewing space of a display device, the method comprising:
-
obtaining, using an image sensor, at least one image of the viewing space; processing the at least one image by at least one processor operatively connected to the image sensor and obtaining data indicative of a location of at least one pointing element in the viewing space; obtaining data indicative of a location of at least one predefined body part of a user in the viewing space; determining by the at least one processor, a location of the aimed point or area in the viewing space using a combination of; the data indicative of the location of the at least one pointing element, the data indicative of the location of the at least one predefined body part, and features with respect to a motion path of the pointing element during a pointing gesture, wherein the motion path is associated with a speed of the pointing gesture; determining the aimed point or area, while obtaining the data indicative of the location of at least one pointing element in the viewing space, wherein the determined aimed point or area is associated with the location of the pointing element while the speed of the pointing gesture is at a minimum; detecting a change in an estimated time until the pointing element will reach a point in the viewing space where the pointing element is closest to the aimed point or area during the pointing gesture; and executing a predefined command or message associated with the aimed point or area.
-
Specification